+- ScrapeBox Forum (https://www.scrapeboxforum.com)
+-- Forum: ScrapeBox Main Discussion (https://www.scrapeboxforum.com/Forum-scrapebox-main-discussion)
+--- Forum: Scrapebox Footprints (https://www.scrapeboxforum.com/Forum-scrapebox-footprints)
+--- Thread: Scraping URLs within a Directory (/Thread-scraping-urls-within-a-directory)
Scraping URLs within a Directory - itsslickrick6 - 05-13-2011
Hey Guys,
New to Scrapebox. I've been doing some research and I can't seem to find the exact answer. This is obviously a phenomenal product so I just wanted to get more information.
I'm sure this is a rookie question, but can anyone tell me how to scrape URLs off a directory from a website?
i.e. - http://www.site.com/blogs/directory/subject/
there are hundreds of pages within this link and I'm trying to scrape all of these pages for the urls on each page.
i know there are custom footprints involved along with other "powered by: name" footprints, however I'm not entirely sure how to go about this.
any information would be most helpful!! Thanks so much!
