NICT · Training crawlers

ICC-Crawler

Crawler of Japan's National Institute of Information and Communications Technology (NICT). The pages it collects are used for research on translation, information analysis and AI, and may be shared with third parties for joint research.

robots.txt name

ICC-Crawler

User agent

ICC-Crawler/3.0 (Mozilla-compatible; ; https://ucri.nict.go.jp/en/icccrawler.html)

Category

Training crawlers: Collect public pages that may be used to train AI models.

Follows robots.txt

Yes

Official documentation

https://ucri.nict.go.jp/en/icccrawler.html

Published IP ranges

https://ucri.nict.go.jp/en/icccrawler.html

Checked against the official documentation on October 17, 2026.

Block or allow it in robots.txt

Add these lines to the robots.txt file at the root of your domain. To block it everywhere:

User-agent: ICC-Crawler
Disallow: /

To allow it everywhere except one folder:

User-agent: ICC-Crawler
Disallow: /private/

Is it really this bot?

Anyone can copy a user agent. To be sure a request comes from NICT, compare its IP address with the ranges the company publishes.