03-03-2019, 03:57 AM
You punched ESET in the face, LOL
Yes, VPN is fine. If you want the truth I don't use proxies when email scraping. The plugin is seen as a browser by the end site and the entire purpose of a site existing is so people can browse it. Plus they have no idea what your doing with the data, your downloading it just like a browser with a person viewing the site.
So I keep connections low and don't use proxies or vpn or antyhing and its fine. The only time you NEED proxies or a VPN is posting, because if there is a complaint.
But anything else its just about speed. Like scraping google, you can do it without proxies, but its SLOOOOOW. So proxies make it faster.
But if a VPN works, its completely fine.
If your scraping form a list of urls, you can radomize domains before you start and that helps, so your not hitting the same domain on multiple pages at once. So then you can use higher connections. IF its all the same domain, you can keep connections lower.
Even with a VPN though you still only have 1 ip, so you dont want to turn the connections up too high because
1 - you can take down a site on cheap hosting because of too many simultaneous connections
2 - the site might block you and then your not getting any emails from it and it defeats your purpose.
Yes, VPN is fine. If you want the truth I don't use proxies when email scraping. The plugin is seen as a browser by the end site and the entire purpose of a site existing is so people can browse it. Plus they have no idea what your doing with the data, your downloading it just like a browser with a person viewing the site.
So I keep connections low and don't use proxies or vpn or antyhing and its fine. The only time you NEED proxies or a VPN is posting, because if there is a complaint.
But anything else its just about speed. Like scraping google, you can do it without proxies, but its SLOOOOOW. So proxies make it faster.
But if a VPN works, its completely fine.
If your scraping form a list of urls, you can radomize domains before you start and that helps, so your not hitting the same domain on multiple pages at once. So then you can use higher connections. IF its all the same domain, you can keep connections lower.
Even with a VPN though you still only have 1 ip, so you dont want to turn the connections up too high because
1 - you can take down a site on cheap hosting because of too many simultaneous connections
2 - the site might block you and then your not getting any emails from it and it defeats your purpose.