Your blog's robots bile is essential because it tells Google search engine which pages to crawl and which not to.
You can choose which search engines you will allow and which ones you will not.
To simply control how search engines view your website, create a Robots.txt file and place it in the root directory.
