08-29-2019, 07:53 PM
Hello,
I have scraped a few hundred thousand URLs for emails in the past 2 weeks. All the urls are instagram accounts. I've gotten over 30k emails using the "Grab/Check -> Check for emails by crawling sites."
Things have been working great until yesterday.
I am not getting any errors, but no emails are being collected. All the urls checked are shown to be "complete," rather than displaying an error message. I manually checked some of the links and there were emails on the pages.
I'm not using any proxies. My delay is 0-2 seconds between actions. I am running on 1 thread. My depth is set to 1 level. I have tried using level 2 depth to see if it would fix my issue but it did not.
I haven't changed any of my settings since I started scraping 2 weeks ago.
One of my associates (located in different state) is having the same exact issue as I am.
Any ideas?
Thanks!
I have scraped a few hundred thousand URLs for emails in the past 2 weeks. All the urls are instagram accounts. I've gotten over 30k emails using the "Grab/Check -> Check for emails by crawling sites."
Things have been working great until yesterday.
I am not getting any errors, but no emails are being collected. All the urls checked are shown to be "complete," rather than displaying an error message. I manually checked some of the links and there were emails on the pages.
I'm not using any proxies. My delay is 0-2 seconds between actions. I am running on 1 thread. My depth is set to 1 level. I have tried using level 2 depth to see if it would fix my issue but it did not.
I haven't changed any of my settings since I started scraping 2 weeks ago.
One of my associates (located in different state) is having the same exact issue as I am.
Any ideas?
Thanks!