jonc at webmaint.com
Fri Feb 20 16:19:45 EST 2004
interchange-users-bounces at icdevgroup.org <> wrote:
> Jon [prtyof5 at attglobal.net] wrote:
>>>> RobotIP <<EOR
>>>> 126.96.36.199, 188.8.131.52, 184.108.40.206,
>>>> 220.127.116.11, 18.104.22.168, 22.214.171.124,
>>>> 126.96.36.199, 188.8.131.52, 184.108.40.206,
>>>> 220.127.116.11?, 18.104.22.168,
>>>> Seems like there should be some 64.68*
>>>> in there shouldn't there ??
>>> Please be so kind to tell us which robots crawling from this IP
>>> block to help the ICDEVGROUP to improve the default settings.
>> Googlebot. Or am I wrong ? Assuming so would it be correct
>> and appropriate to add 64.68? ??
> 64.68.* would cover 65,536 IP addresses. It's probably safe to say
> that they're not all used by spiders. They're definitely not all
> owned by Google. :-)
> For instance, 22.214.171.124/19 is allocated to by "Elan Communications".
> 126.96.36.199/19 is allocated to "Advanced Access" and 188.8.131.52/19
> is allocated to "Cable & Wireless". Within the Cable & Wireless
> block, 184.108.40.206/23 is reallocated (sub-let) to eBay. I believe
> Google has a large block in there somewhere (something like 2048 IPs)
> but I can't find it at the moment, and they're probably not all used
> by spiders anyway.
> A more focused list of addresses may make it into the default set,
> as long as a proper justification is presented. You're free to add
> any addresses you like into your own local configuration, of course.
And this would help anyone wanting to do that:
Google does have more blocks listed, but the referrer id remains the same:
at the moment so IC should behave properly anyway. Out of interest, we are
being spidered from 220.127.116.11/24 at the moment. One server has this block
added, one doesn't. Both are behaving properly for google.
Webmaint.com - Building Clever Websites http://www.webmaint.com/
Webmaint.net - Business Web Hosting http://www.webmaint.net/
WireTel - Internet Connectivity Solutions http://www.wiretel.net/
More information about the interchange-users