Welcome, Guest
You have to register before you can post on our site.

Username
  

Password
  





Search Forums

(Advanced Search)

Forum Statistics
» Members: 2,992
» Latest member: GingerTall
» Forum threads: 1,992
» Forum posts: 16,216

Full Statistics

Online Users
There are currently 102 online users.
» 1 Member(s) | 101 Guest(s)
dichvusocks.us

Latest Threads
[Dichvusocks.us] Service ...
Forum: ScrapeBox Proxies
Last Post: dichvusocks.us
Less than 1 minute ago
» Replies: 3,417
» Views: 714,990
[Vn5socks.net] Service Se...
Forum: ScrapeBox Proxies
Last Post: DavidRock99999
1 hour ago
» Replies: 3,150
» Views: 480,371
Error - 1 Vanity Addon Ch...
Forum: General ScrapeBox Talk
Last Post: loopline
Yesterday, 10:22 PM
» Replies: 1
» Views: 84
Automator not passing det...
Forum: General ScrapeBox Talk
Last Post: loopline
05-23-2017, 09:24 PM
» Replies: 2
» Views: 95
Proxy Speed & SB crashing
Forum: General ScrapeBox Talk
Last Post: scrapingby
05-22-2017, 02:45 PM
» Replies: 4
» Views: 240
Offer : 35% Off With Cana...
Forum: Buy & Sell Items
Last Post: chrisparker
05-22-2017, 05:04 AM
» Replies: 0
» Views: 55
Associating URL to keywor...
Forum: General ScrapeBox Talk
Last Post: loopline
05-20-2017, 12:48 AM
» Replies: 4
» Views: 161
Consolidating Custom Data
Forum: General ScrapeBox Talk
Last Post: scrapingby
05-19-2017, 01:28 PM
» Replies: 0
» Views: 89
Banned proxies
Forum: General ScrapeBox Talk
Last Post: olavor
05-15-2017, 05:30 PM
» Replies: 1
» Views: 160
Fast HTTP/Socks5 proxy fo...
Forum: Buy & Sell Services
Last Post: Nosok
05-15-2017, 03:51 AM
» Replies: 4
» Views: 2,701

 
  Consolidating Custom Data
Posted by: scrapingby - 05-19-2017, 01:28 PM - Forum: General ScrapeBox Talk - No Replies

Ok, so i´m using the custom data grabber to get different sets of data from
a set of profiles but i also want to grab the emails. As far as i understand it 
i cannot use the CDG to grab emails.  What would be the best way or process
 to get both data sets.

Ideally i want to create profiles of people with name, follower count, social media data plus their
email contact data scraped from one or multiple URLs.
 
My approach would be the following
1. use an email crawler that adds url information
2. take the custom data grabber and run those urls
3. somehow consolidate the information using excel or the help of a coder.


Ideally i´d like take custom data grabs from different sites and augment those searches in one database though.
Because in most cases emails are a scarce ressource on one plattform i´d like to search for it on multiple platforms.

My approach for this would be:

1.grab links by crawling a domain/site that has a relatively large amount of the the contacts i´m looking for.
2. use custom data grabber to find name & data like follower count for relevance segmentation.
3. use an email crawler to grab those urls
4.  use the name as search term in a search for "site:otherdomain.com" to get more information/emails from other domains.

please advise if there is an easier process for this or if im overthinking stuff again.


Also when i´m exporting why can´t there be a way to just export ONE URL with all the custom fields instead of having the custom fields repeating all the time?

Print this item

  Automator not passing details to file..
Posted by: trackbikes - 05-18-2017, 07:27 PM - Forum: General ScrapeBox Talk - Replies (2)

I've set up the automated proxy scraper and it's running fine, however despite SB saying that there are 30 proxies that have passed G the file I set up only has 1 proxy listed. I checked the file settings in the automator and it is correct

Followed the excellent videos but i can think what i might have done wrong

Any Clues

Print this item

  Error - 1 Vanity Addon Checker
Posted by: Scross - 05-18-2017, 11:26 AM - Forum: General ScrapeBox Talk - Replies (1)

Hello, what exactly means error - 1 ?

Print this item

  Associating URL to keyword
Posted by: scrapingby - 05-15-2017, 10:00 AM - Forum: General ScrapeBox Talk - Replies (4)

I have a very large keyword list that i´m using for a site:domain.com search to find profiles. (It´s name, emails or other identifying data)

I need to associate each harvested URL with the keyword(s) to find the corresponding profile.


So far i see no way to attach meta information to the URL´s harvested. It that correct?


(I understand that i could use the URLs and then extract the EMAILS + attach the URLS on the export)

Print this item

  Email scraping large site
Posted by: scrapingby - 05-12-2017, 04:05 PM - Forum: General ScrapeBox Talk - No Replies

So i´m trying to email scrape this large site and am getting to my limits.
I´m using a 18k seedlist of URLS and the grab emails from URL list but
SB kept crashing and i lost the harvested emails. Now i´m trying with
just 10 connections ( no proxies) yet and it takes ages.

As loopline mentioned i probably need proxies.
Now the questions is how many do i need?

The site in question has 20 million pages indexed.
If is crawler going through URLS at X per hour/minute second rate
can i assume that if i use more proxies /connections i can simply multiply
the number by the number of proxies? 

It´s been an hour now and it went through roughly 70k urls
can i assume/extrapolate to reach 20 mio. pages in 285 hours more

or less ? Or is it not that simple?


Please help ..i feel stupid

Print this item

  Banned proxies
Posted by: olavor - 05-12-2017, 02:29 PM - Forum: General ScrapeBox Talk - Replies (1)

Hi,

I purchased 10 private proxies and ran the harvester.
No special operators in the keywords. Just regular ones.
I even set a delay of 60 seconds in between keywords.
But proxies got banned after returning results for just 20 keywords!

Got 10 more proxies and did the same test but increased delay for 90 seconds. Still proxies got banned after returning results for only 58 keywords.

That is really low performance.

Any clues of what could be happening?

Thanks

Print this item

  Proxy Speed & SB crashing
Posted by: scrapingby - 05-10-2017, 04:09 PM - Forum: General ScrapeBox Talk - Replies (4)

Hey,
i´m scraping emails from domain lists at around 100k per 5 min. 
Any idea how much faster it will be with proxies? Do 10 proxies mean 10x speed?


Also for some reason SC seems to crash/become nonrespondant after a while..
i think it might have to do with a browser doing parallel work.. can that be or
are there other issues?

Print this item

  IS SB still effective for SEO ranking
Posted by: Otane - 04-30-2017, 05:42 PM - Forum: General ScrapeBox Talk - Replies (1)

I have used GSA and it has made no difference on my sites. I guess all of the sites that GSA posts on are saturated. I like to know if the same is for SB.

Print this item

  Post here if your active
Posted by: dink - 04-28-2017, 09:45 AM - Forum: General ScrapeBox Talk - Replies (6)

As mentioned in the announcement we have seen a decrease in usage and we aren't sure if that's an indication of there being issues with the forum.

If you are able to login and post please leave a single message below

Print this item

  Emails from Serps
Posted by: Nosh - 03-25-2017, 12:37 PM - Forum: General ScrapeBox Talk - Replies (6)

Is it possible to scrape the Google Serps and grab the emails? An example: LinkedIn does not allow scraping, but the emails get indexed in Google.
Example:
site:linkedin.com/in/ OR site:linkedin.com/pub/ "gmail.com" OR "yahoo.com" OR “hotmail.com"OR "mail.com” “Vice president” OR “VP”
Thanks!

Print this item

Looplines Scrapebox List