08-01-2021, 11:30 AM
Thanks for your suggestions. - see response at bottom of this post.
Before I read your reply I tried again aver the last couple of days - as follows
It seems likely initially I got blocked using the Custom harvester as the delay set for Google, Bing and Yahoo did not work (I assume I set it incorrectly).
I think I got blocked on two different days (though no Errors showing in the Custom Harvester Error column - just zero results)
*** How would Scrapebox tell me I am blocked? Particularly as I could do exactly the same search on my browser and get the necessary results without Google Captcha
It looks like my original "too fast" searches has matched the Scrapebox browser profile to my IP and blocked it for maybe 24 hours each time.
I tried again today with Detailed Harvester and global delay of 20 seconds and got 9 sets of valid results, before all results became zero - I also tried some of the zero results in my Chrome browser and all OK with no captcha.
I know that proxies are best solution for Scrapebox, but I use it so infrequently and I am in no urgency for results, I assume the next best option is to find a very long delay that works with Google.
======
Error Logs both open as empty files.
I have just downloaded default engines and created a custom settings for Google with 10 result and 30 seconds delay - I will try again tomorrow and update in a new reply.
Would it be useful for Screpebox to pop up a message when Server Proxies are offline?
Thanks ColinK
Before I read your reply I tried again aver the last couple of days - as follows
It seems likely initially I got blocked using the Custom harvester as the delay set for Google, Bing and Yahoo did not work (I assume I set it incorrectly).
I think I got blocked on two different days (though no Errors showing in the Custom Harvester Error column - just zero results)
*** How would Scrapebox tell me I am blocked? Particularly as I could do exactly the same search on my browser and get the necessary results without Google Captcha
It looks like my original "too fast" searches has matched the Scrapebox browser profile to my IP and blocked it for maybe 24 hours each time.
I tried again today with Detailed Harvester and global delay of 20 seconds and got 9 sets of valid results, before all results became zero - I also tried some of the zero results in my Chrome browser and all OK with no captcha.
I know that proxies are best solution for Scrapebox, but I use it so infrequently and I am in no urgency for results, I assume the next best option is to find a very long delay that works with Google.
======
Error Logs both open as empty files.
I have just downloaded default engines and created a custom settings for Google with 10 result and 30 seconds delay - I will try again tomorrow and update in a new reply.
Would it be useful for Screpebox to pop up a message when Server Proxies are offline?
Thanks ColinK