User-agent: * Allow: / Allow: /index.html Disallow: /cgi-bin/ Disallow: /images/ Disallow: /sitemap/ Disallow: /assets/ Disallow: /editor/ Disallow: /includes/ Disallow: /old web/ Disallow: /templates/ Disallow: /css/ Disallow: /websites/ Disallow: /admin/