ScrapeBox Forum
Custom Data Grabber - Printable Version

+- ScrapeBox Forum (https://www.scrapeboxforum.com)
+-- Forum: ScrapeBox Main Discussion (https://www.scrapeboxforum.com/Forum-scrapebox-main-discussion)
+--- Forum: General ScrapeBox Talk (https://www.scrapeboxforum.com/Forum-general-scrapebox-talk)
+--- Thread: Custom Data Grabber (/Thread-custom-data-grabber)



Custom Data Grabber - tonymgarner - 09-22-2017

Hi

Can the CDG be configured to store the Mask/Field name as well as the URL and DATA scraped.

Then I can do one pass at the scrape and with 2 excel formulas I can tabulate the data extracted into more user friendly form?

At the moment, I am doing 1 pass per mask and then stitching them together in excel.  Each pass is 220,000 URLs' and there are 6 data masks.

Some of the masks have data for every URL and some don't, hence the mask name/field name would be a god send.

Thanks in advance.


RE: Custom Data Grabber - tonymgarner - 09-22-2017

(09-22-2017, 02:48 AM)tonymgarner Wrote: Hi

Can the CDG be configured to store the Mask/Field name as well as the URL and DATA scraped.

Then I can do one pass at the scrape and with 2 excel formulas I can tabulate the data extracted into more user friendly form?

At the moment, I am doing 1 pass per mask and then stitching them together in excel.  Each pass is 220,000 URLs' and there are 6 data masks.

Some of the masks have data for every URL and some don't, hence the mask name/field name would be a god send.

Thanks in advance.
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

A bit sad replying to my own post but I manage to do it.

I have 7 masks that get extracted in 1 pass and using excel, manage to stitch it together into a table of Company Name, addresses, postcode, website etc.

Well pleased.


RE: Custom Data Grabber - channelorange - 10-12-2017

@tonymgarner

can you list out the steps that allowed for 7 masks within 1 pass?