# Define access-restrictions for robots/spiders # http://www.robotstxt.org/wc/norobots.html User-Agent: googlebot Disallow: /*subscribeform Disallow: /*diff$ Disallow: /*clearCache$ User-Agent: slurp Disallow: /*subscribeform Disallow: /*diff$ Disallow: /*clearCache$ User-agent: * Sitemap: http://axiom-wiki.newsynthesis.org/SiteMap?bare=1 Disallow: /*subscribeform Disallow: /*diff$ Disallow: /*clearCache$ |