User-agent: * Disallow: /cgi-bin/ Disallow: /public-html/cgi-bin/ Disallow: /public-ftp/