[ic] New robot?
jon at endpoint.com
Fri Jul 9 16:44:17 UTC 2010
On Fri, 9 Jul 2010, DB wrote:
> Today I noticed spider activity from 18.104.22.168 which seems to be
> from http://panscient.com. Their FAQ shows the UA as:
> User-Agent: panscient.com
> I added this to my local robots.cfg but wanted to share in case this was
> not in the latest version.
Thanks, DB. I added it to robots.cfg in Git.
End Point Corporation
More information about the interchange-users