CODEWITHSUNDEEP
magentorobots.txt
cosimail
cosimail

Reputation: 1

Magento does not generate robots.txt

I'm using Magento ver. 1.9.0.1 and I'm having some trouble with robots.txt.

I set INDEX, FOLLOW on system--> configuration--> design but I can't find robots.txt file in the main directory.

I can't understand what is wrong...maybe I can set a robots.txt file by myself but I suppose it is better to let Magento make it. Thank you very much

Upvotes: 0

Views: 444

Answers (2)

Mukesh
Mukesh

Reputation: 7778

The setting which you are using will create the meta tag on every page as following

<meta name="robots" content="*" />

This setting will not create the robots.txt it self. You have to create robots.txt file by your self in Magento root folder.

Upvotes: 0

Emipro Technologies Pvt. Ltd.
Emipro Technologies Pvt. Ltd.

Reputation: 14746

You have to create manually robots.txt in magento

Upvotes: 1

Related Questions