[ic] Spiders and more lists again

DB DB at M-and-D.com
Fri Sep 3 18:55:25 UTC 2010


> What i did was the following. I added this to robots.txt
> 
> User-agent: *
> Disallow: /admin/
> Disallow: /ord/
> Disallow: /query/
> Disallow: /scan/
> Disallow: /account.html
> Disallow: /process.html
> Disallow: /search.html

[snip]
> René

Thanks - I think that's a pretty good idea!

DB





More information about the interchange-users mailing list