Google · Search indexes
Googlebot
Builds the Google Search index. Rules for Googlebot also apply to Discover, Google Images, Video, Google News and other products, so blocking it removes your pages from Google Search.
- robots.txt name
Googlebot- User agent
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/W.X.Y.Z Safari/537.36- Category
- Search indexes: Crawl the web to build the index of a search engine or AI search.
- Follows robots.txt
- Yes
- Official documentation
- https://developers.google.com/crawling/docs/crawlers-fetchers/google-common-crawlers
- Published IP ranges
- https://developers.google.com/static/crawling/ipranges/common-crawlers.json
Checked against the official documentation on October 17, 2026.
Block or allow it in robots.txt
Add these lines to the robots.txt file at the root of your domain. To block it everywhere:
User-agent: Googlebot
Disallow: /To allow it everywhere except one folder:
User-agent: Googlebot
Disallow: /private/Is it really this bot?
Anyone can copy a user agent. To be sure a request comes from Google, compare its IP address with the ranges the company publishes.
Other bots from Google
- Gemini Notebook · AI answers
- Google-Agent · AI answers
- Google-Extended · Training crawlers
- Google-CloudVertexBot · Other AI bots
- GoogleOther · Other AI bots
See which AI crawlers read your site
Statsdot keeps bots out of your visitors and, with AI crawler tracking, shows which crawlers read your pages and which pages they request. No cookies, no personal data.