[ic] AOL spiders

Grant interchange-users@icdevgroup.org
Fri Dec 6 19:43:01 2002


AOL spiders don't have anything unique in their User Agent, but their
hostname could be used to trap them with something like "spider*aol".  Is
there any way to set functionality like RobotUA's using the spider's
hostname info?

- Grant