SEO Tips

Robots.txt does not keep files out of the search engine indexes. The only thing it does is instruct search engine spiders to not crawl pages. So don't use robots.txt to hide sensitive or private files - it can be a security risk.