[ic] missing.html and a 404
emailgrant at gmail.com
Tue Jan 25 12:38:45 EST 2005
> >>Some search engine spiders keep coming around looking for the same
> >>pages that send them to my missing.html page again and again. I was
> >>wondering if missing.html returns a 404, and I found the following in
> >>the docs:
> >>[tag op=header]Status: 404 missing[/tag]
> >>But If I add that to missing.html I get a blank page (and probably a
> >>404). Does the missing.html page always return a 404 so robots know
> >>what's up?
> >>- Grant
> >Grant, here is a link to a tool that I often use to check things like this:
> >When I use it to query a non-existing page it appears that the default
> >missing.html is in actuality returning a code: 200 Status ok.
> >I placed [tag op=header]Status: 404 missing[/tag] in the missing.html
> >page like this:
> >[tag op=header]Status: 404 missing[/tag]
> >Now when I check the page, I am indeed getting a true 404 code.
> >It looks like I will be updating my catalogs with this change. I hadn't
> >noticed it before. Thanks for pointing this out.
> Ok, I just realized that I did not test the missing page in my browser
> after this change. The spider does indeed get the 404 code with the
> changes above, but the browser does not properly parse the page.
> The following change seems to be working in both the browser and the spider:
> [tag op=header]
> Status: 404 Not found
> Content-type: text/html
> Sorry about that 8).
Either of those [tag] tags just returns a blank page for me. Probably
a 404 too though. You get the whole page when browsing?
More information about the interchange-users