User-agent: * # directed to all spiders Disallow: /cgi-bin/ Disallow: /stat/ Disallow: /js/ Disallow: /graphics/ Disallow: /*.css