+- ScrapeBox Forum (https://www.scrapeboxforum.com)
+-- Forum: ScrapeBox Main Discussion (https://www.scrapeboxforum.com/Forum-scrapebox-main-discussion)
+--- Forum: General ScrapeBox Talk (https://www.scrapeboxforum.com/Forum-general-scrapebox-talk)
+--- Thread: Expired Domain Finder Not Collecting URLs to Crawl (/Thread-expired-domain-finder-not-collecting-urls-to-crawl)
Expired Domain Finder Not Collecting URLs to Crawl - jackcrow - 09-20-2017
Not sure if I'm missing a setting but the "urls to crawl" doesn't collect on certain websites.
For example, it works great on hightimes.com.
However, it won't collect any URLs for weedmaps.com, leafly.com or a dozen other websites. I've tried many different settings but it won't collect.
What am I missing?
RE: Expired Domain Finder Not Collecting URLs to Crawl - loopline - 09-24-2017
Are there urls on those domains that have expired domains? Can you give an example?