[jagan]

As per my idea that each search engine has different method to use robots.txt

Google permits wildcards (*) and the “Allow:” directive, so google has its own new robots.txt guidelines for webmaster so that there will be no mistake by webmasters.