# Robots.txt file for http://www.melbourne2006.com.au # All robots will spider the domain User-agent: * Disallow: /admin/ Disallow: /alpha/ Disallow: /cgi-bin/ Disallow: /Database/ Disallow: /ssl/ Disallow: /swmsm2006/ Disallow: /_settings/ Disallow: /_library/ Disallow: /_element/