Skip to content

Huawei · Training crawlers

PanguBot

Crawler that bot directories attribute to Huawei, used to download training data for its PanGu multimodal language model.

robots.txt name
PanguBot
User agent
Mozilla/5.0 (compatible; PanguBot/1.0; +https://www.huaweicloud.com/)
Category
Training crawlers: Collect public pages that may be used to train AI models.
Follows robots.txt
Yes
Official documentation
https://knownagents.com/agents/pangubot

Checked against the official documentation on October 17, 2026.

Block or allow it in robots.txt

Add these lines to the robots.txt file at the root of your domain. To block it everywhere:

User-agent: PanguBot
Disallow: /

To allow it everywhere except one folder:

User-agent: PanguBot
Disallow: /private/

Is it really this bot?

Anyone can copy a user agent, and Huawei does not publish IP ranges for this bot. A reverse DNS lookup of the IP address may help; check the official documentation.

Other bots from Huawei

See which AI crawlers read your site

Statsdot keeps bots out of your visitors and, with AI crawler tracking, shows which crawlers read your pages and which pages they request. No cookies, no personal data.

Try Statsdot free for 30 days How AI crawler tracking works