[ic] Lots of errors when under heavy load

Kari Suomela interchange-users@icdevgroup.org
Wed Dec 4 20:16:00 2002


Wednesday December 04 2002 08:59, Barry Treahy, Jr. wrote to All:


 BJ> I spotted a lot of errors in our logs this morning and looking 
 BJ> into it
 BJ> further, they are a result of a search engine submission I had 
 BJ> done

Use robots.txt to limit the spiders' activity. There is no advantage of 
having all catalog pages indexed.

 KS

   KARICO Business Services
   Toronto, ON Canada
   http://www.karico.ca

 Get The Pocket Pro now!: http://www.karico.ca/pocketpro.html