+- ScrapeBox Forum (https://www.scrapeboxforum.com)
+-- Forum: ScrapeBox Main Discussion (https://www.scrapeboxforum.com/Forum-scrapebox-main-discussion)
+--- Forum: General ScrapeBox Talk (https://www.scrapeboxforum.com/Forum-general-scrapebox-talk)
+--- Thread: Root URL's & Contact Us Posting (/Thread-root-url-s-contact-us-posting)
Root URL's & Contact Us Posting - tonymgarner - 09-16-2017
Hi
I have scraped a lot of URL's from various sources, some with emails, some without. Those without tend to trap the root URL.
I have seen the contact us video on you tube and can see how to "Inurl" or link the search to the anchor text.
What I am not sure of is where I put the root URL's list.......in the harvestor and then harvest? Do I need to check the platforms or...... I'm not sure.
Thanks in advance.
RE: Root URL's & Contact Us Posting - loopline - 09-18-2017
I would just use the root url list and use the link extractor addon to extract interal links once, as the contact us page is generally linked to from every page on the site. Then you can just use the remove/filter >> remove urls not containing - and then choose "contact" or whatever.
Thats going to be better then using google with search operators because then you don't have to worry about google blocking your ips for advanced operators. Plus the link extractor method will likely be faster.
RE: Root URL's & Contact Us Posting - tonymgarner - 09-19-2017
(09-18-2017, 11:50 PM)loopline Wrote: I would just use the root url list and use the link extractor addon to extract interal links once, as the contact us page is generally linked to from every page on the site. Then you can just use the remove/filter >> remove urls not containing - and then choose "contact" or whatever.
Thats going to be better then using google with search operators because then you don't have to worry about google blocking your ips for advanced operators. Plus the link extractor method will likely be faster.
Yep, that work better than my solution. Great, thanks again.
RE: Root URL's & Contact Us Posting - loopline - 09-20-2017
Your welcome. Cheers!