# /robots.txt file # See http://www.robotstxt.org/wc/faq.html#what for a FAQ # Wildcards are _not_ supported: instead of 'Disallow: /tmp/*' just say 'Disallow: /tmp/'. # You shouldn't put more than one path on a Disallow line #User-agent: * #Disallow: /