+- ScrapeBox Forum (https://www.scrapeboxforum.com)
+-- Forum: ScrapeBox Main Discussion (https://www.scrapeboxforum.com/Forum-scrapebox-main-discussion)
+--- Forum: General ScrapeBox Talk (https://www.scrapeboxforum.com/Forum-general-scrapebox-talk)
+--- Thread: Scraping Deeperweb... Not Working Anymore (/Thread-scraping-deeperweb-not-working-anymore)
Scraping Deeperweb... Not Working Anymore - msj484 - 08-14-2015
Hey All,
Are any of you out there successfully able to scrape DeeperWeb today? I have not be able to scrape it for the past couple of days. This is the query string I'm using in my version of Scrapebox:
http://www.google.com/cse?complete=0&cx=!004415538554621685521:vgwa9iznfuo&cof=FORID:11%3BNB:1&ie=UTF-8&q={KEYWORD}&as_qdr=&ad=n9&num=100&start={PAGENUM}&siteurl=http://deeperweb.com/&nojs=1&filter=0
Please help. Thanks.
RE: Scraping Deeperweb... Not Working Anymore - loopline - 08-17-2015
No I Can't scrape it either. Ill look into it, they probably changed the page formatting or something.
RE: Scraping Deeperweb... Not Working Anymore - msj484 - 08-17-2015
OK. Thanks for the response. Please let us know if you find a solution.
RE: Scraping Deeperweb... Not Working Anymore - msj484 - 09-09-2015
Just following up to see if you've found a work around?
RE: Scraping Deeperweb... Not Working Anymore - loopline - 09-10-2015
Basically Scrapebox was using a no javascript version of the results to get the results because the threads don't support javascript. Well deeperweb is no longer supporting this. So for now it doens't work, not sure if there is a work around, or not. I have mailed support about it to see if they can find a work around.
RE: Scraping Deeperweb... Not Working Anymore - loopline - 09-11-2015
Actually this was fixed the other week, you just need to download the latest engine file.
Go to settings >> harvester engine configuration >> import >> download default engines.
And then it will work.
RE: Scraping Deeperweb... Not Working Anymore - msj484 - 09-11-2015
Wow... Thanks for letting me know. I've been having an issue with Google providing more than 100 results per keyword, but this fixed it. Again, thanks.
RE: Scraping Deeperweb... Not Working Anymore - loopline - 09-13-2015
Yes, there is now a popup when you go to scrape if your engine file is outdated. or a tooltip rather, not a popup so updating is always good.