02-21-2015, 09:32 PM
I'm trying to scrape Google for websites with links pages.
I'm using inurl:".com/links/" & inurl:".net/links/".
Not all sites have this format. Some might be domain.com/dir/dir/links/ etc..
My question is, what operators could I use to scrape as many .com's & .net's with the word links in the url.
I've tried the * wild card but with limited success.
Any ideas folks?
I'm using inurl:".com/links/" & inurl:".net/links/".
Not all sites have this format. Some might be domain.com/dir/dir/links/ etc..
My question is, what operators could I use to scrape as many .com's & .net's with the word links in the url.
I've tried the * wild card but with limited success.
Any ideas folks?