# robots.txt for Statistics New Zealand User-agent: * Disallow: /Sitecore/ Disallow: /unistats/ Disallow: /browse_for_stats/education_and_training/tertiary education/unistats.aspx Disallow: /browse_for_stats/education_and_training/tertiary education/unistats/ User-agent: msnbot Crawl-delay: 0.5 Sitemap: http://search.stats.govt.nz/sitemap.xml