ScrapeBox Forum
Harvesting Domain Exclusion - Printable Version

+- ScrapeBox Forum (https://www.scrapeboxforum.com)
+-- Forum: ScrapeBox Main Discussion (https://www.scrapeboxforum.com/Forum-scrapebox-main-discussion)
+--- Forum: General ScrapeBox Talk (https://www.scrapeboxforum.com/Forum-general-scrapebox-talk)
+--- Thread: Harvesting Domain Exclusion (/Thread-harvesting-domain-exclusion)



Harvesting Domain Exclusion - moobs - 10-07-2016

Is it possible to have SB exclude specific domains while harvesting URLs, is there some sort of blacklist?


RE: Harvesting Domain Exclusion - loopline - 10-07-2016

Sort of. There is indeed a blacklist. However it doesn't happen in real time, so when the harvest is done you go to remove/filter >> apply users local blacklist

You can manage the blacklist in the main menu at the top of scrapebox under blacklist

You can also simply maintain this in a file and then go to remove/filter >> remove urls containing entries from - and then select that text file, this will work with more then just domains.

Or you could maintain a file of just domains and go to import >> import and compare on domain level - and this will remove and domains that are in your list from the domains you harvested.

None of its real time though, Scrapebox will harvest everything and then you just remove it afterward. It used to be real time but that created multiple issues.


RE: Harvesting Domain Exclusion - moobs - 10-08-2016

(10-07-2016, 06:28 PM)loopline Wrote: Sort of. There is indeed a blacklist. However it doesn't happen in real time, so when the harvest is done you go to remove/filter >> apply users local blacklist

You can manage the blacklist in the main menu at the top of scrapebox under blacklist

You can also simply maintain this in a file and then go to remove/filter >> remove urls containing entries from - and then select that text file, this will work with more then just domains.

Understood, thanks.