Reputation: 5
My website is located in a sub folder, but I assigned a domain to this sub folder so the location of the robots.txt file is www.example.com/robots.txt even though I installed Joomla in a subfolder.
Is this correct? Because Google Webmaster Tools does not list the URLs specified in the robots.txt as blocked.
Upvotes: 0
Views: 342
Reputation: 96577
For example.com
, the robots.txt needs to be accessible at example.com/robots.txt
.
It it doesn’t matter how this is accomplished on the server-side.
Upvotes: 1