Wednesday, December 3, 2008

Do you use the robots.txt file on your website?


I am attending weekly SEO seminars given by recognized experts.

You need to know that much of what you read out there about SEO is either flat out wrong or often misunderstood by the person talking about SEO.

Topic: Robots.txt file

A Robots.txt file is not a mandatory requirement by Google and it has little value if not used for a specific purpose....

like making sure the robots don't pick up duplicate content on your website. You can combine the Robots.txt file with a meta robot tag to cover your bases.

If you want to review your error logs in your server, then the robots.txt will help when you see a lot of 404 errors.

A favicon file will also help reduce the number of errors.

Greg Cryns

No comments:

Post a Comment