# CRELoaded Generated Robots.txt # Robot Exclusion File -- robots.txt # Author: CRELoaded Team # Last Updated : May 11th 2005 User-Agent: * Allow: all Disallow: /admin/ Disallow: /download/ Disallow: /includes/ Disallow: /temp/ Disallow: /pub/ Disallow: /etc/ Disallow: /logs/ Disallow: /mail/ Disallow: /tmp/ Disallow: /_mgxftp/ Disallow: /_ mgxroot / Disallow: /images/ Disallow: /templates/ Disallow: /urchin/ Disallow: /.htmltemplates/ Disallow: /.htpasswds/ Disallow: /.neomail/ Disallow: /leech/ Disallow: /public_ftp/ Disallow: /ssl/ Disallow: /catalogdownload/