+- ScrapeBox Forum (https://www.scrapeboxforum.com)
+-- Forum: ScrapeBox Main Discussion (https://www.scrapeboxforum.com/Forum-scrapebox-main-discussion)
+--- Forum: Scrapebox Footprints (https://www.scrapeboxforum.com/Forum-scrapebox-footprints)
+--- Thread: What are the Best Keywords to Use When Scraping? (/Thread-what-are-the-best-keywords-to-use-when-scraping)
What are the Best Keywords to Use When Scraping? - deviantpsyche - 05-25-2011
Hi all,
I'm scraping a bunch of web directories/article directories and I want to get as many as possible, so I got my footprints ready and now trying to figure out what are the best keywords I should use to get as many unique web directories/article directories as possible? I already tried using top 2,000 english words and also a list of category names found on most directories. I'm not very happy with the perecentage of unique domains I'm getting - 99.9% non unique out of about 500,000.
Are there some ways to increase the % of unique domains gathered by using some specific types of keywords? Also, does anyone know if specific search queries like allintitle, allinurl, allintext etc...(or combination of these) yeilds more unique domains when doing large scrapes like this?
Thanks.
RE: What are the Best Keywords to Use When Scraping? - s4nt0s - 05-26-2011
well you can't use "allin" operators with other "allin" operators. What footprint are you using now to find these?
RE: What are the Best Keywords to Use When Scraping? - yongyutu - 06-18-2011
Thank you,Perhaps this to help me!
_______________
microsoft office 2007
Windows 7 Ultimate
RE: What are the Best Keywords to Use When Scraping? - Jackodye - 08-18-2011
There are many keyword tools available online, I use Google Keywords. Word Tracker is a good alternative too.