+- ScrapeBox Forum (https://www.scrapeboxforum.com)
+-- Forum: ScrapeBox Main Discussion (https://www.scrapeboxforum.com/Forum-scrapebox-main-discussion)
+--- Forum: General ScrapeBox Talk (https://www.scrapeboxforum.com/Forum-general-scrapebox-talk)
+--- Thread: question about thread and proxy handling (/Thread-question-about-thread-and-proxy-handling)
question about thread and proxy handling - adam110 - 01-04-2017
hi
I was wondering how threads and proxies tied in together
For example, If I add 10 proxies and tell scrapebox to use 2 threads when harvesting Google then will it use 2 threads per a proxy or will it use 2 proxies at the same time?
so will it make 20 requests at once or 2
and what if i told it to scrape google and yahoo
will it then make 20 requests to google and yahoo or 10 to each or 2 to each or 1 to each at the same time.
Sorry for the confusing question.. and hope it makes sense
Thanks
RE: question about thread and proxy handling - angrykoreaman - 01-04-2017
(01-04-2017, 02:01 AM)adam110 Wrote: hi
I was wondering how threads and proxies tied in together
For example, If I add 10 proxies and tell scrapebox to use 2 threads when harvesting Google then will it use 2 threads per a proxy or will it use 2 proxies at the same time?
so will it make 20 requests at once or 2
and what if i told it to scrape google and yahoo
will it then make 20 requests to google and yahoo or 10 to each or 2 to each or 1 to each at the same time.
Sorry for the confusing question.. and hope it makes sense
Thanks
10 threads means it will use 10 threads. and rotate the proxies being used.
i believe if u have multiple search engines itll go through each of them. 20 requests for both google and yahoo. you will get different results from different search engines.
RE: question about thread and proxy handling - loopline - 01-04-2017
If you set it to 2 threads, it creates a "pool" of 2 threads. So if you have 10 proxies it would use 1 thread per proxy. So 2 threads always.
If you are using 2 engines it will "split" the pool of threads among the engines. Its not exact though, if you use 2 threads and 3 engines scrapebox will only use 2 threads total and bounce around between the 3 engines.
RE: question about thread and proxy handling - adam110 - 01-04-2017
(01-04-2017, 04:39 AM)loopline Wrote: Its not exact though, if you use 2 threads and 3 engines scrapebox will only use 2 threads total and bounce around between the 3 engines.
Perfect thats exactly what i was hoping for.. Our proxy provider restricts the number of threads we are able to use at once so I just wanted to be sure how it worked (we use our proxies in other tools too)