User-agent: * # directed to all spiders Disallow: /cgi-bin Disallow: /graphics Disallow: /images Disallow: /include Disallow: /menu Disallow: /scripts