# Robots.txt file from http://www.searchengineworld.com # # All robots will spider the domain User-agent: * Sitemap: http://www.nothingtodo.co.uk/sitemap.xml Disallow: /amazium/ Disallow: /admin/ Disallow: /includes/ Disallow: /profiles/ Disallow: /staff/ Disallow: /useruploads/ Disallow: /rateitem.php Disallow: /tellafriend.php