Google introduced a new robots.txt tool
The Google Sitemaps team just introduced a new robots.txt tool into Sitemaps. The robots.txt file is one of the easiest things for a webmaster to make a mistake on. Brett Tabke’s Search Engine World has a great robots.txt tutorial and even a robots.txt validator.
http://www.mattcutts.com/blog/new-robotstxt-tool/ |
How is it different from standars Robots.txt
|
As per my idea that each search engine has different method to use robots.txt
Google permits wildcards (*) and the “Allow:” directive, so google has its own new robots.txt guidelines for webmaster so that there will be no mistake by webmasters. |
plz help me
|
All times are GMT. The time now is 08:34 AM. |
Powered by vBulletin® Version 3.5.7
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.