# See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file # # To ban all spiders from the entire site uncomment the next two lines: User-agent: * Disallow: / # Disallow: /chat/ # Disallow: /admin/ # Disallow: /api/ # Disallow: /apiadmin/ # Disallow: /c/api/ # Disallow: /o/api/ # Disallow: /googlec6c85f84cdf0c985.html # Disallow: /watch.html