Reputation: 15369
Google stopped crawling my webpage because my robots.txt
file was inadvertently moved. It said I should try making sure it is there by going to the address: http://www.site.com//robots.txt
. It had two slashes just like that. But it still works. It also works with three. What's up with that? Even if I can sort of see why it could be ignored—I'm not specifying any directory between the two—why would it be preferential to display a url like this, as the google webmasters' page does?
Upvotes: 0
Views: 350
Reputation: 96697
Most (all?) servers seem to allow several slashes directly after the hostname (not in other positions, though), see for example:
(Related question: How to avoid multiple slashes after domain name in url using htaccess?)
However, when Google Webmaster Tools displays the URL with two slashes, you probably have set your domain in the GWT preferences with a trailing slash (http://example.com/
instead of http://example.com
). See this question for Google Analytics (I guess it should be similar for GWT).
Upvotes: 2