Webz.io · Other AI bots
omgili
Older crawler of Webz.io, built for the discontinued Omgili search engine. It indexes news sites, blogs, reviews and forums for the Webz.io data API, which other companies buy.
- robots.txt name
omgili- User agent
omgili/0.5 +https://omgili.com- Category
- Other AI bots: Other automated agents related to AI services.
- Follows robots.txt
- Yes
- Official documentation
- https://webz.io/blog/web-data/what-is-the-omgili-bot-and-why-is-it-crawling-your-website/
Checked against the official documentation on October 17, 2026.
Block or allow it in robots.txt
Add these lines to the robots.txt file at the root of your domain. To block it everywhere:
User-agent: omgili
Disallow: /To allow it everywhere except one folder:
User-agent: omgili
Disallow: /private/Is it really this bot?
Anyone can copy a user agent, and Webz.io does not publish IP ranges for this bot. A reverse DNS lookup of the IP address may help; check the official documentation.
Other bots from Webz.io
- Webzio-Extended · Training crawlers
See which AI crawlers read your site
Statsdot keeps bots out of your visitors and, with AI crawler tracking, shows which crawlers read your pages and which pages they request. No cookies, no personal data.