+- ScrapeBox Forum (https://www.scrapeboxforum.com)
+-- Forum: ScrapeBox Main Discussion (https://www.scrapeboxforum.com/Forum-scrapebox-main-discussion)
+--- Forum: General ScrapeBox Talk (https://www.scrapeboxforum.com/Forum-general-scrapebox-talk)
+--- Thread: Spoofing a header during scraping? (/Thread-spoofing-a-header-during-scraping)
Spoofing a header during scraping? - MichaelA2014 - 01-04-2019
Hi LoopLine and others. Wondering here if it is possible to spoof a header (referrer) while scraping? I hit a site I really need to scrape but the page requires a referrer. It shows 404 if you trying to access url without referrer.
How to go about that?
RE: Spoofing a header during scraping? - loopline - 01-05-2019
Maybe, using what function? Like the custom harvester will let you add whatever header data you want, but not all functions do.
RE: Spoofing a header during scraping? - MichaelA2014 - 01-24-2019
I was scraping expired domains with custom data grabber (right side menu in main window option GRAB)
RE: Spoofing a header during scraping? - loopline - 01-27-2019
The custom data scraper lets you change user agents, but not other header data like referrer.