Looking for url operators - Printable Version

Looking for url operators - Printable Version

+- ScrapeBox Forum (https://www.scrapeboxforum.com)
+-- Forum: ScrapeBox Main Discussion (https://www.scrapeboxforum.com/Forum-scrapebox-main-discussion)
+--- Forum: General ScrapeBox Talk (https://www.scrapeboxforum.com/Forum-general-scrapebox-talk)
+--- Thread: Looking for url operators (/Thread-looking-for-url-operators)

Looking for url operators - ZimmmerSEO - 02-21-2015

I'm trying to scrape Google for websites with links pages.
I'm using inurl:".com/links/" & inurl:".net/links/".
Not all sites have this format. Some might be domain.com/dir/dir/links/ etc..

My question is, what operators could I use to scrape as many .com's & .net's with the word links in the url.

I've tried the * wild card but with limited success.

Any ideas folks?

RE: Looking for url operators - loopline - 02-22-2015

I would go simple.

inurl:links site:com
inurl:links site:net

Google is good at figuring out the rest, you don't need wild cards, the inurl operator already takes care of that.

Then you can tack on keywords

inurl:links site:com 1
inurl:links site:net 2
inurl:links site:com 3
inurl:links site:net a
inurl:links site:com b
inurl:links site:net car
etc....

Remove duplicate urls when you are done and your set.

RE: Looking for url operators - ZimmmerSEO - 02-23-2015

Thanks Loopline,

You are probably right. Despite the power of scrapebox, sometimes an easier approach yields better results

Thanks

I have one question about adding keywords. The merge list puts them in front of the custom footprint. Does that matter? If it does, how do you append them to the footprint as opposed top prepending them?

Thanks

RE: Looking for url operators - loopline - 02-23-2015

(02-23-2015, 11:10 AM)ZimmmerSEO Wrote: Thanks Loopline,

You are probably right. Despite the power of scrapebox, sometimes an easier approach yields better results

Thanks

I have one question about adding keywords. The merge list puts them in front of the custom footprint. Does that matter? If it does, how do you append them to the footprint as opposed top prepending them?

Thanks

It probably does not matter, but you can do it however you like by using tokens. Its explained here:
http://scrapeboxfaq.com/how-do-i-use-tokens-with-the-m-merge-option

but yes, minimum effective dose is the ideal way to go when scraping google.