A robots.txt file is a simple text file that lets search engines know what NOT to crawl and index. If your intention is to allow all search engines to crawl and index all aspects of your site, then you do not need a robots.txt file at all. If, however, you want to block some or all of the search engines from indexing some or all of your site, then you will need to create a robots.txt file. My favorite robots.txt tutorial can be found at https://www.gnc-web-creations.com/creating_robotstxt_file.htm.
About the Author: Donna Fontenot
Donna Fontenot, aka DazzlinDonna, is an Internet Entrepreneur and SEO, who has long utilized search engine optimization and affiliate marketing to create a successful online business. Her goal as an ebusiness coach is to help others make a living online from the comfort of their homes (and in their pajamas). Her motto is "You'll never shine if you don't glow."
