User-agent: * Disallow: /admin/ Disallow: /*.head$ Disallow: /*.tail$ Disallow: /*.txt$ Disallow: /*.css$ Disallow: /*.exe$