10-28-2022, 07:21 AM
Hello,
i currently am using scrapebox with 5 proxies. in order to not get banned by google when scraping sites i increased the time between harvestes.
By default, in platform the maximum limit is 60 seconds. Unfortunately, these days 60s is not enough, my proxies get banned after aprox 12-16 scrapes, even if they rotate. to be able to effectively scrape i need about 10 min delay so at leas 600 seconds.
this theoretically IS possible by editing the userengines dat file. I have done this and put a huge number there - over 3000 seconds (just to test). See image.
However, this does not work as intended even it it is showed in scrapebox (the 3000+s delay). the maximum delay is still 60 sec. i believe the upper 60s limit somehow overwrites any number placed there.
I have tested this - watched the scrapebox window with a timer and the delay is 60s
Can this limit be increased?
i currently am using scrapebox with 5 proxies. in order to not get banned by google when scraping sites i increased the time between harvestes.
By default, in platform the maximum limit is 60 seconds. Unfortunately, these days 60s is not enough, my proxies get banned after aprox 12-16 scrapes, even if they rotate. to be able to effectively scrape i need about 10 min delay so at leas 600 seconds.
this theoretically IS possible by editing the userengines dat file. I have done this and put a huge number there - over 3000 seconds (just to test). See image.
However, this does not work as intended even it it is showed in scrapebox (the 3000+s delay). the maximum delay is still 60 sec. i believe the upper 60s limit somehow overwrites any number placed there.
I have tested this - watched the scrapebox window with a timer and the delay is 60s
Can this limit be increased?