#**************************************************************************** # robots.txt # : Tells robots (spiders) which files it may crawl (download). # : This system is called "The Robots Exclusion Standard." #**************************************************************************** User-agent: * Disallow: /demo/