+- ScrapeBox Forum (https://www.scrapeboxforum.com)
+-- Forum: ScrapeBox Main Discussion (https://www.scrapeboxforum.com/Forum-scrapebox-main-discussion)
+--- Forum: General ScrapeBox Talk (https://www.scrapeboxforum.com/Forum-general-scrapebox-talk)
+--- Thread: OI! Massive amount of URLs removed! (/Thread-oi-massive-amount-of-urls-removed)
OI! Massive amount of URLs removed! - team74 - 09-02-2010
I scarped 50k webpages, then after harvesting was done, 92% of these domains were removed. It says "maybe too many keywords were similar" ???
I was left with only 700 results after all that time.
Why does this keep happening? I didn't press any buttons it just immediately deletes 9 out of 10 results.
Thanks.
PS. Just did another harvest, 140,000 blogs reduced to 9114. What gives?
EDIT/UPDATE: I've figured it out. SB crashed and I recovered the harvested file... which contain 140,000 entries. SB was deleting duplicate domains automatically. I thought you had to initiate this process which was why I was so confused!
RE: OI! Massive amount of URLs removed! - billkruse - 09-03-2010
No, it takes them out automatically in recent versions which is no bad thing as you don't want to be posting the same or spun comments on the same blog.
BB