[ic] Robots

Steve Graham icdev at mrlock.com
Tue Nov 17 17:04:13 UTC 2009

> Hi - just for fun I visited
> http://about.ask.com/en/docs/about/webmasters.shtml#8 which says that
> Ask's current spider reports itself as
> User-Agent: Mozilla/2.0 (compatible; Ask Jeeves/Teoma)
> I do see such entires in my sites access log, but my current robots.cfg
> appears to have no such entry. Perhaps someone who is able should make
> that change?
> DB

There was a discussion recently about RobotUA, but I couldn't find the 

Check here for the current github version:


More information about the interchange-users mailing list