Robots.txt Generator

Robots.txt Generator


:  
    
:
    
:  
     
: Google
  Google Image
  Google Mobile
  MSN Search
  Yahoo
  Yahoo MM
  Yahoo Blogs
  Ask/Teoma
  GigaBlast
  DMOZ Checker
  Nutch
  Alexa/Wayback
  Baidu
  Naver
  MSN PicSearch
   
: "/"
 
 
 
 
 
 
   




Robots.txt Generator

Your blog's robots bile is essential because it tells Google search engine which pages to crawl and which not to.

You can choose which search engines you will allow and which ones you will not.

To simply control how search engines view your website, create a Robots.txt file and place it in the root directory.