Webz.io · Training crawlers

Webzio-Extended

Marks the data Webz.io collects as usable or not usable for AI and machine-learning training. Webz.io sells web data to other companies; blocking this agent signals that your content should not be offered for AI training.

robots.txt name

Webzio-Extended

User agent

Webzio-Extended

Category

Training crawlers: Collect public pages that may be used to train AI models.

Follows robots.txt

Yes

Official documentation

https://webz.io/blog/company/from-omgilibot-to-the-webzbot-duo-a-powerful-leap-for-ethical-and-comprehensive-data-collection/

Checked against the official documentation on October 17, 2026.

Block or allow it in robots.txt

Add these lines to the robots.txt file at the root of your domain. To block it everywhere:

User-agent: Webzio-Extended
Disallow: /

To allow it everywhere except one folder:

User-agent: Webzio-Extended
Disallow: /private/

Is it really this bot?

Anyone can copy a user agent, and Webz.io does not publish IP ranges for this bot. A reverse DNS lookup of the IP address may help; check the official documentation.

Other bots from Webz.io

• omgili · Other AI bots