# This allows all bots everywhere: User-agent: * Disallow: # This disallows all bots to several directories and files: User-agent: * Disallow: /admin/ Disallow: /class/ Disallow: /includes/ Disallow: /scripts/ Disallow: /resource/ Disallow: /search/ Disallow: /Templates/ Disallow: /cgi-bin/ Disallow: /stats/