[ic] New Robot UAs
emailgrant at gmail.com
Sun Jan 16 01:42:13 UTC 2011
>>> I've been going through Apache data lately and have discovered at
>>> least two new robots
>>> that ought to be added to robots.cfg:
>>> 1) 'bingbot'
>>> Looks like Microsoft has changed the UA for MSNBot, but Interchange is
>>> no longer recognizing it.
>> It should still recognize it, as the simple term "bot" is in the RobotUA
>> Neverless I added it.
> SurveyBot is also not triggering the spider detection. Maybe the
> "bot" entry only works if it appears after a delimiter in the UA?
> - Grant
Also AdsBot of "AdsBot-Google-Mobile
More information about the interchange-users