Ok so I just checked my VPS and its completed the harvesting again - this time it completed it in 20 mins (I loaded over 11k keywords)
Im not sure what is going on but this has happened a few times now
by the way im on the very latest update
I just restarted it again as before and its running super smooth again - What do you think the issues could be?
ok so i made 1 change the last few days. I changed my back-connect proxies to rotate every 5 mins as opposed to every 10 mins (I thought this would be a good thing as it gives me a different IP every 5 mins as opposed to 10.
So I have just switched it back to 10 mins rotation.. I really dont know if this could be the cause but Im seeing how it runs. for now its been about 14 mins without a single error. I was able to get over 24 hours worth of scraping with almost 0 errors which is what im trying to get back :-)
By the way I am working with 100 proxies and 8 threads
Im not sure what is going on but this has happened a few times now
by the way im on the very latest update
I just restarted it again as before and its running super smooth again - What do you think the issues could be?
ok so i made 1 change the last few days. I changed my back-connect proxies to rotate every 5 mins as opposed to every 10 mins (I thought this would be a good thing as it gives me a different IP every 5 mins as opposed to 10.
So I have just switched it back to 10 mins rotation.. I really dont know if this could be the cause but Im seeing how it runs. for now its been about 14 mins without a single error. I was able to get over 24 hours worth of scraping with almost 0 errors which is what im trying to get back :-)
By the way I am working with 100 proxies and 8 threads