[ic] search engine indexing scan/ MM=0f73bb47ac44f4e422.....
peter at pajamian.dhs.org
Sat Jun 17 09:14:53 EDT 2006
On 06/17/2006 05:03 AM, Kevin Walsh wrote:
> Another way would be to recognise spiders and reduce the size of the
> HTML output. Only showing a list of links to products (dropping all
> the nice user-orientated stuff like prices and images) is one way to
> do that.
Be careful about doing that. Google has been known to blacklist sites
that return a different page to thier spiders than what gets shown to a
More information about the interchange-users