03-21-2015, 02:23 AM
(This post was last modified: 03-21-2015, 03:10 AM by scanner737.)
I paused the harvester for about 6 hours to see if that would do anything. When I unpaused, the harvested URL number began going up again with no errors, and it's climbing pretty quickly, pretty much in increments of 100 every few seconds. It's almost as if it was still gathering URLs while it was paused and now it's just actually adding them to the total. Also, the average URL's per second has been stuck on 9 for about 12 hours now. Strange.
Update: Then, after about 20 minutes of this, it reverted to its behavior of no new harvested URLs and the error counter goes up incrementally again.
Again, anyone experiencing similar behavior, if you want to chime in that'd be great.
Update: Then, after about 20 minutes of this, it reverted to its behavior of no new harvested URLs and the error counter goes up incrementally again.
Again, anyone experiencing similar behavior, if you want to chime in that'd be great.