Zo72
Zo72

Reputation: 15355

robots.txt and seo ranking

is there any point in having a robots.txt with just one line of content like below

User-agent: *

compared to not having it at all ?

Upvotes: 1

Views: 253

Answers (2)

Nick Allen
Nick Allen

Reputation: 12230

No, google (and let's not beat around the bush, Google is the search engine you should care about) by default will crawl everything unless you tell it not to.

If you want to help Google, use google webmaster tools and submit a sitemap in the correct format

http://www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156184

Upvotes: 0

SLaks
SLaks

Reputation: 888203

No; there is no point in doing that.

Upvotes: 1

Related Questions