# Block all Search Engines from indexing these directories. # Basically, disallow any dir. and the files within them, you don't want SEs to index. User-agent: * Disallow: /admin/ Disallow: /cgi-bin/ Disallow: /cache/ Disallow: /docs/ Disallow: /docs/ Disallow: /download/ Disallow: /editors/ Disallow: /email/ Disallow: /faq/ Disallow: /media/ Disallow: /new/ Disallow: /old/ Disallow: /oops/ Disallow: /pub/ Disallow: /temp/ Disallow: /service/