Google · AI answers
Google-Agent
Used by AI agents hosted on Google infrastructure to navigate websites and carry out actions at a user's request.
- robots.txt name
Google-Agent- User agent
Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; Google-Agent; +https://developers.google.com/crawling/docs/crawlers-fetchers/google-agent) Chrome/W.X.Y.Z Safari/537.36- Category
- AI answers: Fetch a page when someone asks an assistant about it.
- Follows robots.txt
- No. The company says that because a user requested the fetch, it generally ignores robots.txt rules.
- Official documentation
- https://developers.google.com/crawling/docs/crawlers-fetchers/google-user-triggered-fetchers
Checked against the official documentation on October 17, 2026.
Block or allow it in robots.txt
Add these lines to the robots.txt file at the root of your domain. To block it everywhere:
User-agent: Google-Agent
Disallow: /
To allow it everywhere except one folder:
User-agent: Google-Agent
Disallow: /private/
This bot does not always follow robots.txt. To keep it out for sure, block it on your server or firewall by user agent and, where published, by IP range.
Is it really this bot?
Anyone can copy a user agent. To be sure a request comes from Google, compare its IP address with the ranges the company publishes.
Other bots from Google
- Gemini Notebook · AI answers
- Googlebot · Search indexes
- Google-Extended · Training crawlers
- Google-CloudVertexBot · Other AI bots
- GoogleOther · Other AI bots
See which AI crawlers read your site
Statsdot keeps bots out of your visitors and, with AI crawler tracking, shows which crawlers read your pages and which pages they request. No cookies, no personal data.