# robots.txt for http://www.canita.com/ User-agent: * Crawl-delay: 10 Disallow: /inc/ Disallow: /admin/ Disallow: /css/