CODEWITHSUNDEEP
robots.txtgooglebot
randomguy
randomguy

Reputation: 12242

How to disallow a certain action?

I'd like to disallow /questions/{ID}/foo but not /questions/{ID}.

Is the syntax Disallow: /questions/*/foo?

Upvotes: 2

Views: 411

Answers (1)

Paulo Santos
Paulo Santos

Reputation: 11567

A good place to start looking for the proper syntax should be here:

Note also that globbing and regular expression are not supported in either the User-agent or Disallow lines. The '*' in the User-agent field is a special value meaning "any robot". Specifically, you cannot have lines like "User-agent: *bot*", "Disallow: /tmp/*" or "Disallow: *.gif".

Upvotes: 1

Related Questions