11-02-2011, 08:17 AM
Hi,
During the last few days I have found a nice load of urls and have some more work to do.
I use 10 private proxies and yesterday Google stopped giving me results, now I get nothing from any search engine.
This is the heaviest use of SB I have made, in all I probably scraped 500,000 urls in 4 days. I have also filtered out a load of rubbish and obtained PR for perhaps 100,000 urls. I also did a run of 50000 urls for 'dofollow' yesterday.
Would this type of use burn the proxies out?
They have always been really good. I use Matt Rankin shared private proxies which I found way better than the squid private proxies which were utterly hopeless.
Any ideas guys?
Should I write to Matt?
Thanks!
During the last few days I have found a nice load of urls and have some more work to do.
I use 10 private proxies and yesterday Google stopped giving me results, now I get nothing from any search engine.
This is the heaviest use of SB I have made, in all I probably scraped 500,000 urls in 4 days. I have also filtered out a load of rubbish and obtained PR for perhaps 100,000 urls. I also did a run of 50000 urls for 'dofollow' yesterday.
Would this type of use burn the proxies out?
They have always been really good. I use Matt Rankin shared private proxies which I found way better than the squid private proxies which were utterly hopeless.
Any ideas guys?
Should I write to Matt?
Thanks!