User-agent: * Disallow: /archive/ Disallow: /mailer/ Disallow: /administrator/ Disallow: /admin/ Allow: / User-agent: Mediapartners-Google Allow: / User-agent: 008 Disallow: / User-agent: Baiduspider Disallow: /