emailgrant123b at yahoo.com
Sat Feb 21 12:50:26 EST 2004
--- Kevin Walsh <kevin at cursor.biz> wrote:
> Grant [emailgrant123b at yahoo.com] wrote:
> > > A more focused list of addresses may make it
> into the default set,
> > > as long as a proper justification is presented.
> You're free to
> > > add any addresses you like into your own local
> > > of course.
> > >
> > Why would you want to use IPs instead of UAs?
> For spiders who don't identify themselves using a
> UA, or set the UA
> to pretend to be MSIE etc. Common examples are
> spambots. There are
> also "IP" spiders, such as those you may have seen
> from the
> 18.104.22.168/27 range. Spambots and IP spiders
> don't follow the
> established rules, such as honouring robots.txt, so
> are best blocked
> from the firewall. Other spiders may be more
> friendly, despite not
> being reliably identifiable using the UA.
I see, but RobotIP doesn't do any blocking at the
firewall, right? I thought all RobotIP/UA did was
suppress sessions and keep other forms of "URL
variables" out of the URL. How is that useful for a
spambot or other rule-not-follower?
Do you Yahoo!?
Yahoo! Mail SpamGuard - Read only the mail you want.
More information about the interchange-users