ScrapeBox Forum
Expired Domain Finder Not Collecting URLs to Crawl - Printable Version

+- ScrapeBox Forum (https://www.scrapeboxforum.com)
+-- Forum: ScrapeBox Main Discussion (https://www.scrapeboxforum.com/forumdisplay.php?fid=1)
+--- Forum: General ScrapeBox Talk (https://www.scrapeboxforum.com/forumdisplay.php?fid=2)
+--- Thread: Expired Domain Finder Not Collecting URLs to Crawl (/showthread.php?tid=8395)



Expired Domain Finder Not Collecting URLs to Crawl - jackcrow - 09-20-2017

Not sure if I'm missing a setting but the "urls to crawl" doesn't collect on certain websites.

For example, it works great on hightimes.com.

However, it won't collect any URLs for weedmaps.com, leafly.com or a dozen other websites. I've tried many different settings but it won't collect.

What am I missing?


RE: Expired Domain Finder Not Collecting URLs to Crawl - loopline - 09-24-2017

Are there urls on those domains that have expired domains? Can you give an example?