Paulo Brian Samson
Paulo Brian Samson

Reputation: 3

googlebot crawling webservice

is there some way to make googlebot not to crawl links that is used for webservice? When I try to access my webservice on url it returns 500 error when there no parameters passed. Or is there also some way to prevent an http 500 error when I try to access my webservice in url without parameters?

THanks.

Upvotes: 0

Views: 226

Answers (1)

bartlaarhoven
bartlaarhoven

Reputation: 845

You could take a look here to create a robots.txt.

Upvotes: 1

Related Questions