02-16-2017, 08:01 PM
I have huge site that has hundreds of thousands of emails that I´d like to scrape.
All the emails are on the surface, so a simple site:domain.com would suffice.
I succeeded scraping a few hundred.
Can someone tell me how many proxies i would need to scrape something like 500.000 pages?
Also how would i best go about in terms of organization?
All the emails are on the surface, so a simple site:domain.com would suffice.
I succeeded scraping a few hundred.
Can someone tell me how many proxies i would need to scrape something like 500.000 pages?
Also how would i best go about in terms of organization?