How to check if site is accessible to search bot

Question

Are there any tests that I can run to see if search bots can access my site?

Answer 1

1. spec: http://www.robotstxt.org/

2. Syntax check: http://www.searchenginepromotionhelp.com/m/robots-text-tester/robots-checker.php

3. accessibility check: http://phpweby.com/services/robots

_{All of which are friends of google, so it seemed}