# This file is designed to limit the access of compliant bots, spiders and webcrawlers User-agent: * Disallow: /cfide/ Disallow: /images/ Disallow: /adminarea/ Disallow: /cfdocs/ Disallow: /faculty/ Disallow: /exchange2/ User-agent: Slurp Crawl-delay: 10 User-agent: msnbot Crawl-delay: 10 User-agent: twiceler Crawl-delay: 10 User-agent: googlebot Crawl-delay: 10 User-agent: Mediapartners-Google Disallow: / User-agent: Googlebot-Image Disallow: / User-agent: Adsbot-Google Disallow: /