[ic] Where is robots.cfg included?
emailgrant at gmail.com
Wed Mar 3 00:10:42 UTC 2010
>> I'd like to switch from my manually-built RobotsUA definition to the
>> IC robots.cfg file. I thought it would be included from catalog.cfg,
>> but I don't see a reference to it in the latest version. Where is
>> robots.cfg called from?
> It's global, see:
> # Include individual usertags.
> include usertag/*.tag
> # Include the robot recognition lists
> include robots.cfg
> # Include the list of country-specific standardised subdomains
> include subdomains.cfg
Thank you Gert. Has anyone run into problems relying on robots.cfg?
More information about the interchange-users