ScrapeBox Forum
Page Scanner is not recording Results - Printable Version

+- ScrapeBox Forum (https://www.scrapeboxforum.com)
+-- Forum: ScrapeBox Main Discussion (https://www.scrapeboxforum.com/Forum-scrapebox-main-discussion)
+--- Forum: General ScrapeBox Talk (https://www.scrapeboxforum.com/Forum-general-scrapebox-talk)
+--- Thread: Page Scanner is not recording Results (/Thread-page-scanner-is-not-recording-results)



Page Scanner is not recording Results - goozleology - 03-04-2021

Basically, I've created some footprints and the Page Scanner scans and says it's completed but there are no results.

Here's a video with more details: https://share.getcloudapp.com/7KupZAge

As far as I can tell, I've set everything up correctly.


RE: Page Scanner is not recording Results - loopline - 03-04-2021

Try it without proxies, does it work? I doubt it will but its a quick easy test. When it says completed but no match, the code was not found. So if the page is an iframe or is producing the content you want via javascript then scrapebox will not execute scripts. So if you post a couple of example urls and one of the footprints that you want to see on that page, we can have a look. Just reply here.

However you can turn off javascript in your browser and load the page. Then do ctrl+U to see the actual html of the page. Dont do an inspect element because that executes scripts, if you just view the source, thats without scripts executed, which is how scrapebox sees it.


RE: Page Scanner is not recording Results - goozleology - 03-05-2021

Unfortunately, I can't post a link because it's a member site. However, I have been able to use all other Scrapebox tools on it, so I don't think it's an access issue.

And I tried your suggestions. Here's a video: https://share.getcloudapp.com/BluYPGoY

It's just baffling.

Thanks


RE: Page Scanner is not recording Results - loopline - 03-06-2021

Video is perfect.

When all the options in the page scanner are selected, it will search thru them until it finds a match and then quit and list whatever it found as the match. So with your 4 choices, its not going to report on each one, its just going to tell you which one the first one it found a match on.


As for why it won't work, Scrapebox can't see the data. I typed out one url from your list

biggerpockets.com/users/RobertC314

If you go there in a browser that is not signed into the membership site, you can see a snipit of text, but that is all, thats what scrapebox is seeing too.

Now google may be able to see behind the membership wall, sometimes they can. Also you can try messing with some scrapebox settings that allow cookie headers, like the harvester and maybe get some progress. However for the most part scrapebox is going to see what you see in a browser where you are Not signed in.


RE: Page Scanner is not recording Results - goozleology - 03-07-2021

(03-06-2021, 09:50 PM)loopline Wrote: Video is perfect. 

When all the options in the page scanner are selected, it will search thru them until it finds a match and then quit and list whatever it found as the match.  So with your 4 choices, its not going to report on each one, its just going to tell you which one the first one it found a match on. 


As for why it won't work, Scrapebox can't see the data.  I typed out one url from your list

biggerpockets.com/users/RobertC314

If you go there in a browser that is not signed into the membership site, you can see a snipit of text, but that is all, thats what scrapebox is seeing too. 

Now google may be able to see behind the membership wall, sometimes they can.  Also you can try messing with some scrapebox settings that  allow cookie headers, like the harvester and maybe get some progress.  However for the most part scrapebox is going to see what you see in a browser where you are Not signed in.