ScrapeBox Forum
Running multiple threads on a scrape - Printable Version

+- ScrapeBox Forum (https://www.scrapeboxforum.com)
+-- Forum: ScrapeBox Main Discussion (https://www.scrapeboxforum.com/Forum-scrapebox-main-discussion)
+--- Forum: General ScrapeBox Talk (https://www.scrapeboxforum.com/Forum-general-scrapebox-talk)
+--- Thread: Running multiple threads on a scrape (/Thread-running-multiple-threads-on-a-scrape)



Running multiple threads on a scrape - Donstar - 09-17-2015

Hey,

I'm running a scrape in Scrapebox V2., I've got multiple private proxies activated and want to run several threads at once - I can't see any option to do this, does anyone know how?

Thanks


RE: Running multiple threads on a scrape - Daydee - 09-18-2015

adjust it in the main settings .


RE: Running multiple threads on a scrape - Donstar - 09-18-2015

Got any more details on this? I've checked main settings


RE: Running multiple threads on a scrape - Daydee - 09-18-2015

I believe each "Search Engine" used will be one thread sorry thought it was ur settings

recap choose 1 SE and 1 thread chose 8 SE and get 8 threads


RE: Running multiple threads on a scrape - loopline - 09-19-2015

You need to use custom harvester as detailed harvester is single threaded only. As noted by Daydee just go to settings >> connections timeouts and other settings and change the harvester connectiosn to what you want.

However I should note that if you choose 10 threads, its a pool, not per engine. So if you choose 10 threads and 1 engines that engine gets all 10 threads. If you choose 10 threads and 5 engines then each engine gets about 2 threads. At any given time 1 might have 1 and another might have 3, but its more or less. Also note as an engine completes threads are still pooled, so if you have 5 engines and 2 of them complete then the 10 threads are then being used by 3 engines so more threads per engine all the way down to the last engine getting all 10 threads until its done, just something to note.