+- ScrapeBox Forum (https://www.scrapeboxforum.com)
+-- Forum: ScrapeBox Main Discussion (https://www.scrapeboxforum.com/Forum-scrapebox-main-discussion)
+--- Forum: General ScrapeBox Talk (https://www.scrapeboxforum.com/Forum-general-scrapebox-talk)
+--- Thread: Scrapping Google "reasonably" without triggering spam filter (/Thread-scrapping-google-reasonably-without-triggering-spam-filter)
Scrapping Google "reasonably" without triggering spam filter - Xuzo - 01-02-2021
My goal is to do some scrapes to get list of businesses per city.
I need to send about 500 emails per day, I use the inurl:contact to make sure that the results have a contact page, and then I extract the email address from that.
So I figure I might batches of about 2000 URL's not sure yet...
Can I safely crawl 1000-5000 url results a day with the default proxies that come with scrapebox (using the option "harvest proxies")
RE: Scrapping Google "reasonably" without triggering spam filter - loopline - 01-02-2021
not from google, possibly from bing. But if you go slow with a delay you could crawl that much from google with a handful of private proxies, probably 5 or 10 proxies.