User-agent: CCBot Crawl-Delay: 20 User-agent: SemrushBot Crawl-Delay: 50 User-agent: gsa-crawler Disallow: * Sitemap: https://press.uchicago.edu/docroot/sitemap.xml Sitemap: https://press.uchicago.edu/docroot/authorsSitemap.xml Sitemap: https://press.uchicago.edu/docroot/cBooksSitemap.xml Sitemap: https://press.uchicago.edu/docroot/dBooksSitemap.xml User-Agent: * Crawl-Delay: 2 Disallow: /books/compcopy* Disallow: /books/textadoption* Disallow: /books/downloadSubjectCsv* Disallow: /journals/e-readers/processor/* Disallow: *.ctl Disallow: *.epl