The
Google Sitemaps team just introduced a
new robots.txt tool into Sitemaps. The
robots.txt file is one of the easiest things for a webmaster to make a mistake on. Brett Tabke’s
Search Engine World has a great robots.txt tutorial and even a robots.txt validator.
http://www.mattcutts.com/blog/new-robotstxt-tool/