Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Spoofing a header during scraping?
#1
Hi LoopLine and others. Wondering here if it is possible to spoof a header (referrer) while scraping? I hit a site I really need to scrape but the page requires a referrer. It shows 404 if you trying to access url without referrer.

How to go about that?
Reply
#2
Maybe, using what function? Like the custom harvester will let you add whatever header data you want, but not all functions do.
Reply




Users browsing this thread: 2 Guest(s)