09-30-2013, 03:03 PM
I have about 2,000 of these entries on my site due to robot.txt file lockout (see note below) and of course since they are all dupe content google will only show one and tell you to click the See More button to see them.. of course Scrape Box cannot read and as far as I know does not understand to click the See more button... is there a way to make this happen... since scrape box is returning only the one result and then quitting...
I can write a program to do this but wonder if Scrape Box can be commanded to do anything like this?
NOTE:
this is the view coming up in google when you ask scrape box to go here....
A description for this result is not available because of this site's robots.txt – learn more.
I can write a program to do this but wonder if Scrape Box can be commanded to do anything like this?
NOTE:
this is the view coming up in google when you ask scrape box to go here....
A description for this result is not available because of this site's robots.txt – learn more.