[ic] Spiders gone berserk?

[dzhang-msi]

----- Original Message -----
From: "DB" <DB@M-and-D.com>
To: <interchange-users@icdevgroup.org>
Sent: Tuesday, February 11, 2003 9:21 AM
Subject: [ic] Spiders gone berserk?


> All these sessions seem excessive and I can block the IP, but I don't
> want to stop search engines from crawling my site. On the other hand it
> goes on for hours and all this eats bandwidth and CPU time. Have other
> seen such behavior?
>
> DB
>

How large your site is? Do you think it takes hours for a search engine to
fetch pages of your sites?

David
dzhang@msihosting.com
http://www.msihosting.com
Expert -- ecommerce solution, interchange hosting