10-12-2014, 06:41 PM
I have 10 private proxies (squid) that show a 302 error in scrapebox testing, but in the squid Proxy Manager using my IP address they all test fine. I had just run a large scrape, am I blocked somehow?
10-12-2014, 06:41 PM
I have 10 private proxies (squid) that show a 302 error in scrapebox testing, but in the squid Proxy Manager using my IP address they all test fine. I had just run a large scrape, am I blocked somehow?
10-12-2014, 11:53 PM
Yes, google will ban ips for different types of queries. So you can build a proxy test for the type of query that your doing.
I explain the concept of the ban in this video: https://www.youtube.com/watch?v=P9CbGhfc1aY
10-13-2014, 01:41 PM
Error 302 means your ip's are banned by google. Simply error 302 is about blokes IP. Harvesting using private proxies is not recommended, When you use scraper, then search engine use both private and public IP in the same manner.
10-13-2014, 02:24 PM
So its best to try and use free proxies for scraping, I am trying some Reverse Proxy Ports that change IP every 10 minutes. So did I kill my squid proxies. Do you know if they replace? (are they banned due to my ignorance of running 10 threads at once?) Scraping should be done with one thread? Thanks for your help!
10-16-2014, 10:20 PM
Google will unban ips generally in 12-48 hours so its no big deal. The reverse back connect proxies work pretty good, I use them as well. Also you can use private proxies just fine, but you just have to lower the connections.
(10-16-2014, 10:20 PM)loopline Wrote: Google will unban ips generally in 12-48 hours so its no big deal. The reverse back connect proxies work pretty good, I use them as well. Also you can use private proxies just fine, but you just have to lower the connections. Thanks, squid actually replaced the proxies and I am taking it slower now
10-18-2014, 10:46 PM
Good deal. Your welcome.
|
|