Google seems to be finding a "sitemap-questions-0.xml" on android.stackexchange.com. However, when I go to click on it, I get a 404 error. Here's the link that Google gives me: https://android.stackexchange.com/sitemap-questions-0.xml

Here's a screenshot:

enter image description here

Is this an old result from when Googlebot did its crawling, or does the file actually exist but return a 404 to prevent regular users from trying to access it?


This is part of the site's Sitemap - a machine-readable directory for search engines.

It's only served to search engines, since it can be quite large and isn't particularly useful to anyone else. Normally, this wouldn't show up in Google's search results - I would expect it to disappear eventually.

  • Does it determine that by user agent? In other words, if I was to mimic the user agent of Googlebot, would it serve it to me?
    – gparyani
    Oct 14 '13 at 6:41
  • Yes it would, @gparyani
    – Shog9
    Oct 14 '13 at 9:05

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .