Generate Instant Copy Using AI. Claim your free 10,000 words

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
What am I doing wrong?
#1
Hey there: I need to scrape all the pages of a given site.

Then I enter "site:mysite.com" in the harvester browser, > Custom footprint>Yahoo .

Then I enter "mysite.com" in the KWs window>Start Harvesting.

All the pages appear on the URLs Harvested window as required, but a note pops up: "xx domain(s) removed from the list. 97% of the harvested results have been removed. Maybe too many similar keywords have been used"

Any only the main domain remains.

What am I doing wrong?
Thank you
Reply
#2
Under the options menu you probably have "automatically remove bla bla bla". Uncheck that box and you should be fine.
Reply
#3
(09-09-2010, 02:47 PM)archkre Wrote: Hey there: I need to scrape all the pages of a given site.

Then I enter "site:mysite.com" in the harvester browser, > Custom footprint>Yahoo .

Then I enter "mysite.com" in the KWs window>Start Harvesting.

All the pages appear on the URLs Harvested window as required, but a note pops up: "xx domain(s) removed from the list. 97% of the harvested results have been removed. Maybe too many similar keywords have been used"

Any only the main domain remains.

What am I doing wrong?
Thank you

Yes hoyce is right. Go to options and uncheck, "automatically remove duplicate domains".

Also, the site: search operator won't give you all the websites pages. Only the ones that have been indexed by the search engines.

To find more pages go to the add ons menu at the top and use the, "link extractor". Make sure and check internal links button. That should give you a lot more results.

Reply




Users browsing this thread: 1 Guest(s)