# karstunderwaterresearch.org -- www.karstunderwaterresearch.org # Robot Exclusion File -- robots.txt # Last Updated: 3.26.2009 13:00:56 WEP User-agent: Gigabot Disallow: / User-agent: baiduspider Disallow: / User-agent: BecomeBot Disallow: / User-agent: NaverBot Disallow: / User-agent: TurnitinBot Disallow: / User-agent: FAST-WebCrawler Disallow: / User-agent: Mercator Disallow: / User-agent: NPBot Disallow: / User-agent: ZyBorg Disallow: / User-agent: RoboCrawl Disallow: / User-agent: OmniExplorer Disallow: / User-agent: * Disallow: /aspnet_client Disallow: /images Disallow: /upload Disallow: /includes Disallow: /hold Disallow: /js Disallow: /styles Disallow: /tools Disallow: /database Disallow: /projects/diveplans