[ic] New Robot UAs
emailgrant at gmail.com
Fri Dec 30 01:03:21 UTC 2011
>> I've been going through Apache data lately and have discovered at
>> least two new robots
>> that ought to be added to robots.cfg:
>> 1) 'bingbot'
>> Looks like Microsoft has changed the UA for MSNBot, but Interchange is
>> no longer recognizing it.
> It should still recognize it, as the simple term "bot" is in the RobotUA
> Neverless I added it.
If bingbot in robots.cfg doesn't change any behavior, I suggest it is removed.
More information about the interchange-users