[ic] HELP - Inktomisearch stuck on ord/basket.html page

Andrew Rich andrew at mapsdownunder.com.au
Tue Oct 26 07:34:34 EDT 2004


> 
> Stefan Hornburg wrote:
> >>And this is from Apache access log.
> >>
> >>lj1244.inktomisearch.com - - [26/Oct/2004:10:16:45 +1000] "GET
> >>/cgi-bin/mapshop/ord/basket.html HTTP/1.0" 302 157
> >>lj1090.inktomisearch.com - - [26/Oct/2004:10:16:46 +1000] "GET
> >>/cgi-bin/mapshop/ord/basket.html HTTP/1.0" 302 157
> >>lj1249.inktomisearch.com - - [26/Oct/2004:10:16:46 +1000] "GET
> >>/cgi-bin/mapshop/ord/basket.html HTTP/1.0" 302 157
> >>lj1191.inktomisearch.com - - [26/Oct/2004:10:16:47 +1000] "GET
> >>/cgi-bin/mapshop/ord/basket.html HTTP/1.0" 302 157
> >>lj1244.inktomisearch.com - - [26/Oct/2004:10:16:48 +1000] "GET
> >>/cgi-bin/mapshop/ord/basket.html HTTP/1.0" 302 157
> >>lj1090.inktomisearch.com - - [26/Oct/2004:10:16:49 +1000] "GET
> >>/cgi-bin/mapshop/ord/basket.html HTTP/1.0" 302 157
> >>
> >>So there are many hits by inktomisearch on this one page.  We didn't
> >>have a problem with Inktomisearh until recently.
> >
> >
> > I would say that your site triggers a bug in the Inktomi search
> > engine. Just loading the same URL over and over.
> 
> Slurp does have problems with redirects (301 and 302), but this should
> not cause it to get stuck in this way.
> 
> What I don't understand is why it is getting a redirect in the first
> place. Requests for the basket page seem to be getting redirected to
the
> basket page in an infinite loop - this is not good.
> 
> To see what I mean try this:
> 
>    wget http://demo.icdevgroup.org/i/demo1/ord/basket.html
> 
> --
> Jamie Neil | <jamie at versado.net> | 0870 7777 454

So what do I make of this?  I try the above on the demo site and on our
site with the same result.

wget http://demo.icdevgroup.org/i/demo1/ord/basket.html
--21:37:54--  http://demo.icdevgroup.org/i/demo1/ord/basket.html
           => `basket.html'
Resolving demo.icdevgroup.org... done.
Connecting to demo.icdevgroup.org[69.57.146.17]:80... connected.
HTTP request sent, awaiting response... 302 moved
Location: http://demo.icdevgroup.org/i/demo1/ord/basket.html [following]
http://demo.icdevgroup.org/i/demo1/ord/basket.html: Redirection cycle
detected.

This must be a new bug as I changed the site after the problem started!

I do have this setting in the httpd.conf file:

SSL area
RedirectMatch permanent ^/$
https://www.mapsdownunder.com.au/cgi-bin/mapshop/


Non SSL area
RedirectMatch permanent ^/$
http://www.mapsdownunder.com.au/cgi-bin/mapshop/

Any idea?
In the short term fix I will do the robots.txt but I would like to know
what is the best interchange way!  Robots, Action Maps etc

Regards,
Andrew Rich




More information about the interchange-users mailing list