Cohere · Training crawlers
cohere-training-data-crawler
Crawler that bot directories attribute to Cohere, used to download training data for the language models behind its enterprise AI products.
- robots.txt name
cohere-training-data-crawler- User agent
cohere-training-data-crawler- Category
- Training crawlers: Collect public pages that may be used to train AI models.
- Follows robots.txt
- Yes
- Official documentation
- https://knownagents.com/agents/cohere-training-data-crawler
Checked against the official documentation on October 17, 2026.
Block or allow it in robots.txt
Add these lines to the robots.txt file at the root of your domain. To block it everywhere:
User-agent: cohere-training-data-crawler
Disallow: /To allow it everywhere except one folder:
User-agent: cohere-training-data-crawler
Disallow: /private/Is it really this bot?
Anyone can copy a user agent, and Cohere does not publish IP ranges for this bot. A reverse DNS lookup of the IP address may help; check the official documentation.
See which AI crawlers read your site
Statsdot keeps bots out of your visitors and, with AI crawler tracking, shows which crawlers read your pages and which pages they request. No cookies, no personal data.