+- ScrapeBox Forum (https://www.scrapeboxforum.com)
+-- Forum: ScrapeBox Main Discussion (https://www.scrapeboxforum.com/Forum-scrapebox-main-discussion)
+--- Forum: General ScrapeBox Talk (https://www.scrapeboxforum.com/Forum-general-scrapebox-talk)
+--- Thread: Page Scanner Addon - Delay? (/Thread-page-scanner-addon-delay)
Page Scanner Addon - Delay? - colink - 03-16-2021
I am currently testing some functions using Scrapebox without proxies.
Google and Bing Meta Scraper offer a "delay between requests" option in connection settings (so I can can test a long list with delays of 12 to 30 seconds without getting blocked).
I do not see an option for "delay between requests" for the Page Scanner Addon.
Is there a way to set a delay in Page Scanner Addon?
I am using page scanner to search google results and find which pages have Google My Business, A Video section or Image section
eg https://www.google.com/search?q=ford+mustang
I did a test of 1000 similar URL's and it completed in about 10 minutes but after about 700 results it returned about 300 results with "HTTP/1.1 429 Too Many Requests" in the Status column.
One surprise is that I was able to do a manual search in browser while this was running and after it finished without a Captcha challenge.
Thanks ColinK
RE: Page Scanner Addon - Delay? - colink - 03-18-2021
With no replies, I am assuming that "delay between requests" is not possible with Page Scanner Addon.
If I am wrong, great.
If I am right could I request that "delay between requests" be added to this addon? @loopline
Thanks ColinK
RE: Page Scanner Addon - Delay? - loopline - 03-18-2021
There is no delay option in page scanner. I will pass to the dev team for consideration.
RE: Page Scanner Addon - Delay? - loopline - 03-20-2021
There is a new update of the addon, if you update your request has been added.
RE: Page Scanner Addon - Delay? - colink - 03-27-2021
(03-20-2021, 10:45 PM)loopline Wrote: There is a new update of the addon, if you update your request has been added.
That is the best service I have ever had, after a feature request, from any software owner / developer ever!!
Thanks very much.
PS - I saw your message a week ago but on my iPad the logon button would not respond, hence the delay on my response / thanks - until I got back to my PC.
ColinK
RE: Page Scanner Addon - Delay? - loopline - 03-27-2021
All good, glad that you like Scrapebox!