ScrapeBox Forum
Scrapebox Blacklist - Never Harvest a Duplicate URL? - Printable Version

+- ScrapeBox Forum (https://www.scrapeboxforum.com)
+-- Forum: ScrapeBox Main Discussion (https://www.scrapeboxforum.com/Forum-scrapebox-main-discussion)
+--- Forum: General ScrapeBox Talk (https://www.scrapeboxforum.com/Forum-general-scrapebox-talk)
+--- Thread: Scrapebox Blacklist - Never Harvest a Duplicate URL? (/Thread-scrapebox-blacklist-never-harvest-a-duplicate-url)



Scrapebox Blacklist - Never Harvest a Duplicate URL? - kingtana - 04-05-2012

From what i understand, the Blacklist will not only keep you from posting to specific urls, but it will also keep you from harvesting the same url again.

I'm pondering the thought to add my master list of harvested urls to the Blacklist so i don't harvest the same url twice. Seems like it would save a lot of time.

Can you guys shed some light on this topic? Does anyone recommend or not recommend this for any reason?