pmhoran
New member
I do a basic "behind the scenes" maintenance on a forum owned by a friend of mine.
I have always been used to going onto the site & seeing 1, 2 or even 3 spiders at a time from various search engines.
Lately though ... Inktomi/Yahoo have had multiple dozens of spiders skittering all over the site just about any time of the day or night I have gone into the forum.
The fewest I have seen at one time is 27 (today) ... and have seen up to 80+ ... just from Inktomi/Yahoo.
In my mind, that is being just plain rude. One or even a few I can see. But GEEZ ... wouldn't 30 or 80 of the suckers there at one time be sucking up a bunch of unnecessary bandwidth???
I sent them an email about 10 days ago asking them to explain WHY they felt they needed so many spiders at one time on the site ... but so far have received no response.
I am soooooo tempted just to totally BAN access to any part of the site (not just the forum) by Inktomi/Yahoo. At least until they give me an explanation or something. But ... don't want the site to disappear from their search engine either.
So ... anyone have any thoughts, input, suggestions or solutions????
Many thanks
Peter
I have always been used to going onto the site & seeing 1, 2 or even 3 spiders at a time from various search engines.
Lately though ... Inktomi/Yahoo have had multiple dozens of spiders skittering all over the site just about any time of the day or night I have gone into the forum.
The fewest I have seen at one time is 27 (today) ... and have seen up to 80+ ... just from Inktomi/Yahoo.
In my mind, that is being just plain rude. One or even a few I can see. But GEEZ ... wouldn't 30 or 80 of the suckers there at one time be sucking up a bunch of unnecessary bandwidth???
I sent them an email about 10 days ago asking them to explain WHY they felt they needed so many spiders at one time on the site ... but so far have received no response.
I am soooooo tempted just to totally BAN access to any part of the site (not just the forum) by Inktomi/Yahoo. At least until they give me an explanation or something. But ... don't want the site to disappear from their search engine either.
So ... anyone have any thoughts, input, suggestions or solutions????
Many thanks
Peter