User-agent: * Disallow: /files/ Disallow: /swarm/ Disallow: /ads/ Disallow: /doc/ Disallow: /jquery/ Disallow: /_rhtcore/