# robots.txt for children1st.org.uk User-agent: * Allow: / # some ources say above line invalid and ought to be 'Disallow: ' but some authorities back it up so I'm happy. Even if invalid, has desired effect Crawl-delay: 5 Disallow: /disaster/ Disallow: /disaster/secure/ Disallow: /jump~poiuy/