[ic] RobotIPs

Grant emailgrant123b at yahoo.com
Sat Feb 21 12:50:26 EST 2004

--- Kevin Walsh <kevin at cursor.biz> wrote:
> Grant [emailgrant123b at yahoo.com] wrote:
> > > A more focused list of addresses may make it
> into the default set,
> > > as long as a proper justification is presented. 
> You're free to
> > > add any addresses you like into your own local
> configuration,
> > > of course.
> > >
> > Why would you want to use IPs instead of UAs?
> > 
> For spiders who don't identify themselves using a
> UA, or set the UA
> to pretend to be MSIE etc.  Common examples are
> spambots.  There are
> also "IP" spiders, such as those you may have seen
> from the
> range.  Spambots and IP spiders
> don't follow the
> established rules, such as honouring robots.txt, so
> are best blocked
> from the firewall.  Other spiders may be more
> friendly, despite not
> being reliably identifiable using the UA.

I see, but RobotIP doesn't do any blocking at the
firewall, right?  I thought all RobotIP/UA did was
suppress sessions and keep other forms of "URL
variables" out of the URL.  How is that useful for a
spambot or other rule-not-follower?

- Grant

Do you Yahoo!?
Yahoo! Mail SpamGuard - Read only the mail you want.

More information about the interchange-users mailing list