06-13-2016, 05:34 AM
Hi
I have to get a real bunch of urls from Google (nothing special, like inurl, simple top-10 urls, but some millions), so i'm interesting for adequate settings for such case. I plan the following setup:
- 6 threads,
- 240 proxies, (semi-ded from buyproxies)
- 40-45 seconds delay.
With these settings i will try to query 6 queries/keywords à second and get 6 x 10 top-10 urls.
40 seconds delay is the value i even got from scraping google with iMacro, if scraping in a single thread.
Does somebody have other values? Any advice is highly appreciated!
I have to get a real bunch of urls from Google (nothing special, like inurl, simple top-10 urls, but some millions), so i'm interesting for adequate settings for such case. I plan the following setup:
- 6 threads,
- 240 proxies, (semi-ded from buyproxies)
- 40-45 seconds delay.
With these settings i will try to query 6 queries/keywords à second and get 6 x 10 top-10 urls.
40 seconds delay is the value i even got from scraping google with iMacro, if scraping in a single thread.
Does somebody have other values? Any advice is highly appreciated!