User-Agent: * Disallow: /cgi-bin/ Disallow: .htaccess Disallow: go.db Disallow: readme.txt Disallow: licence.txt Disallow: config.php