03-21-2015, 09:24 PM
(03-21-2015, 09:25 AM)gopo2k Wrote: Yes. You have too few proxies and too many threads.
Get 100 proxies and use 5 threads at once.
In ratio to what he is using now, he has about 100 proxies at 3 connections so your suggestion would actually make the problem worse, but you are on right track, just not with the number of proxies and threads persay.
~~~~~~~~~~~~~~~`
OP your proxies are getting banned. Thats why the errors. When you paused some of them got unblocked and thus the reason it worked fine for 20 mins and then started over.
The google test only tests against basic keyewords, not advanced operators. You can have proxies that work fine for 1 query and are blocked for the next. I have a video on it here:
https://www.youtube.com/watch?v=P9CbGhfc1aY
You could build a custom test with your exact query and then you would see exact results.
You would just need more proxies, perhaps as much as 50+ total with 1 connection for advanced operators.
Also I would recommend using the detailed harvester, it still only harvests at 1 connection but will give you more details and has the option to add a delay.
So you could wait 48 hours for your ips to be unbanned and then add a 2-5 second delay.
Or you could try some back connect proxies for harvesting, they change the ip every 10 mins on the back end.
Recommendations here:
http://scrapeboxfaq.com/scrapebox-proxies
The bar at the bottom is percentage of total keywords completed.
Scrapebox will have no problem with that volume of keywords, as long as you are using the 64bit version.
The overall effect is to bear in mind that V2 is highly optimized for Scraping and its VERY fast at scraping google, so the concept of using 1 connection on 30 proxies in V1 is probably fine as the harvester is slower. The concept in general just keeps things slow enough you don't get your ips banned, but V2 is so fast and optimized its rotating thru the ips quicker, hence the ban. So you have to add a delay or more proxies to slow things back down to a speed where you won't get banned. That or use back connect proxies that just rotate so you don't have to worry about bans as much.