Robots.txt creator

Default -  All Robots are:        

Specific Robots:

Google  

Google Image Search  

MSN Search  

Yahoo  

Ask/Teoma  

GigaBlast  

Scrub The Web  

DMOZ Listing Checker  

Nutch  

Become    

Restricted Directories: The path is relative to root and must contain a trailing "/"  

 

 

 

 

   


Now, copy and paste this text into a blank text file called
"robots.txt" (don't forget the "s" on the end of "robots")
and put it in your root directory.


From Cached Blog http://www.cached.it/english/blog/  

Warning: mysql_connect() [function.mysql-connect]: Unknown MySQL server host 'db2.netcat.it' (1) in /data2/hosting/big/www_cached_it/html/config3.php on line 8

Warning: mysql_select_db(): supplied argument is not a valid MySQL-Link resource in /data2/hosting/big/www_cached_it/html/config3.php on line 9

Warning: mysql_query() [function.mysql-query]: Access denied for user 'hosting'@'localhost' (using password: NO) in /data2/hosting/big/www_cached_it/html/english/post_blog.php on line 14

Warning: mysql_query() [function.mysql-query]: A link to the server could not be established in /data2/hosting/big/www_cached_it/html/english/post_blog.php on line 14

Warning: mysql_fetch_object(): supplied argument is not a valid MySQL result resource in /data2/hosting/big/www_cached_it/html/english/post_blog.php on line 15