# robots.txt for http://www.qimr.edu.au/ # # Created: JP 2000-02-23 # Modified: JP 2000-02-27 - added /webglimpse/ # # Basically open slather except stay out of Intranet space. Just for # safety's sake, also ban any indexing of "non-html" directories like # styles, includes, webglimpse etc. In theory these shouldn't get # visited by a crawler anyway since no pages contain URL's which point # into them but not 100% sure how the crawlers crawl so safety first. User-agent: * Disallow: /email-addresses/ Disallow: /intranet/ Disallow: /getfiles/ Disallow: /autoproxy/ Disallow: /styles/ Disallow: /webglimpse/ Disallow: /images/ Disallow: /missing.html Disallow: /pending.html