+- ScrapeBox Forum (https://www.scrapeboxforum.com)
+-- Forum: ScrapeBox Main Discussion (https://www.scrapeboxforum.com/Forum-scrapebox-main-discussion)
+--- Forum: General ScrapeBox Talk (https://www.scrapeboxforum.com/Forum-general-scrapebox-talk)
+--- Thread: Do I need to get new Private Proxies with a 503? (/Thread-do-i-need-to-get-new-private-proxies-with-a-503)
Do I need to get new Private Proxies with a 503? - 23efwdsc - 12-30-2016
I purchased 50 private proxies for Google scraping and now I am seeing 503 errors.
Will these IPs not work for me anymore, or will they be allowed after a certain timeframe?
Do I need to ask my proxy provider for new ones?
(BTW, I reviewed all of Looplin'es videos and thought I was under the threshold - I had my detailed harvester delay at 30, and max threads at 10, guess I got busted somehow!)
Thanks!
RE: Do I need to get new Private Proxies with a 503? - loopline - 12-30-2016
They will unblock in 12-48 hours typically. Then they should work fine.
As for the threshold it varies based on the query type.
I would try upping the delay to like 60 and see if that helps. The detailed harvester is only single threaded, so the connection settings don't apply to it, so you don't need to worry about that. If 60 delay works fine, then try lowering it little by little till you get blocked and you will know where your threshold is.
RE: Do I need to get new Private Proxies with a 503? - 23efwdsc - 12-30-2016
Ok, got it thank you for the reply. The release notes say the detailed harvester is slower, but it doesn't say that it is single-threaded. Thanks for pointing that out now that you mention it, it makes sense given the way the numbers were moving in the stats. I'll up to 60, and use the custom harvester. THX!
RE: Do I need to get new Private Proxies with a 503? - loopline - 12-31-2016
Your welcome, but that won't work. The delay does not apply to the custom harvester.
The logic is that if you need a delay, you don't need more then 1 connection anyway, which is true. However you may have to shift your thinking, but if you want to run 2 connections at 60 delay, 1 connection at 30 delay is the same thing.
So unless your doing some custom site and wanting like 3 connections with a 1 second delay, where 1 connection would need 1/3rd of a second delay, then you can handle anything by lowering connections and increasing the delay, hence 1 connection is not only fine, but ideal for many other reasons.
That said, 3 connections with 1 second delay makes no sense with google, so using 1 connection is fine.
RE: Do I need to get new Private Proxies with a 503? - 23efwdsc - 01-02-2017
Got it - I was using the detailed harvester but for not any reason in particular. I switched to Custom harvester and everything is working fine now.