06-26-2015, 03:07 PM
Well the link extractor doesn't inherantly need proxies, but if the end site has blocked your ip, perhaps from too many requests. Then yes you need to use proxies and make sure you don't go too fast. Meaning if your hammering away on 1 domain with 100 connections thats sucking up a lot of their server resources and may make them ban your proxies too so just be mindful of the number of connections your hitting concurrently on 1 domain.
1 connection per ip is probably a good ratio.
1 connection per ip is probably a good ratio.