CODEWITHSUNDEEP
drupaldrupal-6
AgA
AgA

Reputation: 2126

Can I add sites/default/files in robots.txt?

Customers in my site sometimes upload files in node which are stored in sites/default/files. Ideally I'd want the file to be hidden from the world. I was shocked one day to find Google listing one private file in its search results.

So can I add this directory in robots.txt? Will it affect anything else? At least search engines will not bring those files open to the world!

Upvotes: 0

Views: 306

Answers (1)

Andrei Stanca
Andrei Stanca

Reputation: 908

If you add the uploads directory to robots.txt google will skip it.

This is how you can add stuff to robots.txt:

User-agent: *
Disallow: /folder/
Disallow: /folder/file.htm

Upvotes: 1

Related Questions