12-14-2014, 12:07 PM
(This post was last modified: 12-14-2014, 12:12 PM by ccastell88.)
Hi i've basically added around 99,000 keywords to Srapebox and want to scrape the top 20 ranking urls for each keyword. So in total it should harvest around 19,800,00.
However i ran the harvest with 20 proxies (custom harvester and use multi threaded harvester are unchecked)
And the total harvested URLs is only 239,820 once scrapebox has completed.
Does anyone know why this is the case?
I have automatically remove duplicate domains disabled.
Kind Regards,
ccastell88
However i ran the harvest with 20 proxies (custom harvester and use multi threaded harvester are unchecked)
And the total harvested URLs is only 239,820 once scrapebox has completed.
Does anyone know why this is the case?
I have automatically remove duplicate domains disabled.
Kind Regards,
ccastell88