An AI crawler is a bot an answer engine sends to read your site. Each one has its own name and its own behavior, and they do not all respect robots.txt the same way, so welcoming or blocking them is a per-bot decision, not one switch.
Why it matters
If an engine's crawler cannot read your pages, nothing downstream matters: you will not be cited by a system that never saw you. Crawlability is the floor the rest of AI visibility stands on.
The catch is that the bots differ. Some declare themselves and honor your rules, some ignore robots.txt, and some are training crawlers you may want to treat differently from the ones that fetch a live answer.
So the real question is not whether you are blocking AI, but which bots, on purpose. A blanket rule copied from a template often blocks the exact crawler you wanted to reach.
How Jinn treats it
Jinn keeps an inventory of the known AI crawlers, maintained from the public ai.robots.txt list the community keeps current, with each bot's operator and stated behavior on record.
Against that inventory it reads your robots.txt per bot and reports the honest three-state answer: allowed, blocked, or unknown. It never renders an ambiguous rule as a confident pass.
The free Agent Access Checker reads your robots.txt per AI bot and tells you allowed, blocked, or unknown. See it
Related terms
Which bots you welcome, on purpose.
Not a blanket rule copied from a template. Check which AI crawlers can actually reach your site, free.