ScrapeBox Forum
ScrapeBox 2.0.0.97 detail harvested stuck after 19 queries - Printable Version

+- ScrapeBox Forum (https://www.scrapeboxforum.com)
+-- Forum: ScrapeBox Main Discussion (https://www.scrapeboxforum.com/Forum-scrapebox-main-discussion)
+--- Forum: General ScrapeBox Talk (https://www.scrapeboxforum.com/Forum-general-scrapebox-talk)
+--- Thread: ScrapeBox 2.0.0.97 detail harvested stuck after 19 queries (/Thread-scrapebox-2-0-0-97-detail-harvested-stuck-after-19-queries)



ScrapeBox 2.0.0.97 detail harvested stuck after 19 queries - yann_scrapebox - 02-25-2018

Hello all,
I'm a happy user of this wonderful software.
I have purchased 22 private proxies at MPP and I'm trying to use the detail harvester with a list of 1300 keywords expressions with queries like this :

name1 surname1 photo
name2 surname2 photo
etc...

I put only 1 engine, a delay of 120 seconds and a maximum of 4 results per query. I think this could be enough for Google (I only use this search engine, no other).
When I perform a search, I can do 19 search and then Scrapebox tries every proxy in my list and fails to return any result for the next searchs. 
I thought that Google blocked my IPs, but when I scramble the keyword in my list and begin a new search again, Scrapebox manages to obtain 4 results for every of the 19 first queries and then is stuck again looping among proxies before failing to return any results.
I don't know if it's a Google, Proxy or Scrapebox issue ??

Thanks a lot for any help you can provide.
Have a nice sunday.


RE: ScrapeBox 2.0.0.97 detail harvested stuck after 19 queries - yann_scrapebox - 02-25-2018

I stumbled upon this thread : http://www.www.scrapeboxforum.com/showthread.php?tid=44497
I opened the detailed harvester Error Log and the only errors found are those types of errors :


25/02/2018 11:43:59: HTTP: 500 , SOCKET: Connection timed out, URL: http://www.google.com/search?complete=0&hl=en&q=elliott%20erwitt%20photo&num=100&start=0&filter=0&pws=0 Proxy: HIDDEN
25/02/2018 11:44:09: HTTP: 500 , SOCKET: Connection timed out, URL: http://www.google.com/search?complete=0&hl=en&q=elliott%20erwitt%20photo&num=100&start=0&filter=0&pws=0 Proxy: HIDDEN
25/02/2018 11:44:10: HTTP: 0 , SOCKET: Connection reset by peer, URL: http://www.google.com/search?complete=0&hl=en&q=elliott%20erwitt%20photo&num=100&start=0&filter=0&pws=0 Proxy: HIDDEN


RE: ScrapeBox 2.0.0.97 detail harvested stuck after 19 queries - loopline - 02-27-2018

Google doesnt' return 500 and error zero. These are either proxy errors or something is blocking scrapebox like security software.

So whitelist scrapebox in all security software such as anti-virus, malware checkers and firewalls. Then also you can whitelist in your router.

Try it with no proxies, as a sample, does it work?

If the proxies are blocked you will typically see 503 or 302.