# if you want to add own robot rules, do it BEFORE the final rule matching * Disallow: /ilog/ Disallow: /forum/ Crawl-delay: 20 User-agent: *