I scarped 50k webpages, then after harvesting was done, 92% of these domains were removed. It says "maybe too many keywords were similar" ???
I was left with only 700 results after all that time.
Why does this keep happening? I didn't press any buttons it just immediately deletes 9 out of 10 results.
Thanks.
PS. Just did another harvest, 140,000 blogs reduced to 9114. What gives?
EDIT/UPDATE: I've figured it out. SB crashed and I recovered the harvested file... which contain 140,000 entries. SB was deleting duplicate domains automatically. I thought you had to initiate this process which was why I was so confused!
I was left with only 700 results after all that time.
Why does this keep happening? I didn't press any buttons it just immediately deletes 9 out of 10 results.
Thanks.
PS. Just did another harvest, 140,000 blogs reduced to 9114. What gives?
EDIT/UPDATE: I've figured it out. SB crashed and I recovered the harvested file... which contain 140,000 entries. SB was deleting duplicate domains automatically. I thought you had to initiate this process which was why I was so confused!