08-17-2015, 09:56 PM
You can do it a few days. All engines limit you to a max of 100 results, and google often cuts you off with a soft limit of 400-600 results.
So you would want to tack on keywords and force google to return different sets of results from its database.
site:business.yahoo.com
site:business.yahoo.com a
site:business.yahoo.com b
site:business.yahoo.com c
site:business.yahoo.com 1
site:business.yahoo.com 2
site:business.yahoo.com 3
site:business.yahoo.com car
site:business.yahoo.com green
etc...
Then just remove duplicate urls when done.
Also you can then use the link extractor to extract internal and external links.
So you would want to tack on keywords and force google to return different sets of results from its database.
site:business.yahoo.com
site:business.yahoo.com a
site:business.yahoo.com b
site:business.yahoo.com c
site:business.yahoo.com 1
site:business.yahoo.com 2
site:business.yahoo.com 3
site:business.yahoo.com car
site:business.yahoo.com green
etc...
Then just remove duplicate urls when done.
Also you can then use the link extractor to extract internal and external links.