Skip to content

Exa · Search indexes

ExaSearchBot

Crawler of the Exa search engine, which indexes public pages so people and applications can find, retrieve and cite them. Pages Exa fetches on a user's request go out under a different name, ExaUser.

robots.txt name
ExaSearchBot
User agent
Mozilla/5.0 (compatible; ExaSearchBot/1.0; +https://crawler.exa.ai/)
Category
Search indexes: Crawl the web to build the index of a search engine or AI search.
Follows robots.txt
Yes
Official documentation
https://crawler.exa.ai/

Checked against the official documentation on October 17, 2026.

Block or allow it in robots.txt

Add these lines to the robots.txt file at the root of your domain. To block it everywhere:

User-agent: ExaSearchBot
Disallow: /

To allow it everywhere except one folder:

User-agent: ExaSearchBot
Disallow: /private/

Is it really this bot?

Anyone can copy a user agent, and Exa does not publish IP ranges for this bot. A reverse DNS lookup of the IP address may help; check the official documentation.

See which AI crawlers read your site

Statsdot keeps bots out of your visitors and, with AI crawler tracking, shows which crawlers read your pages and which pages they request. No cookies, no personal data.