Know exactly which AI agents can read your content
Publishers need a deliberate stance on AI crawlers. See which assistants your robots.txt allows, which actually reach your pages, and whether your articles are citable when they do.
Why publishers need a clear view
Robots rules, CDN bot protection and paywalls interact in ways that are hard to see. Many sites block agents they meant to allow, or allow ones they meant to block.
An intentional access policy
Per-agent robots.txt rules that match your licensing and traffic decisions.
Citable articles
Clear headlines, authors, dates and Article markup so content can be attributed correctly.
Readable text
Article copy present in the HTML rather than loaded behind scripts.
What the audit checks for you
- robots.txt policy per AI agent alongside the observed homepage request result
- Citability signals: headings, authorship, publication dates and Article markup
- Readable content in the raw HTML versus the browser view
- Site identity and Organization details
- Scheduled monitoring that flags when agent access changes
We check your homepage and site-wide public files, not every page or real assistant answers. Incomplete checks stay clearly marked.
Article · Example publication
How cities are rethinking transit
- AuthorA. Writer
- PublishedDated in markup
- Body textIn the HTML
- Agent policySet per agent
Someone asks: “Who wrote this, and when?”
Headline, author and date can be attributed.
Common questions
- Do you recommend allowing or blocking AI crawlers?
- That's your decision. We show what your current setup actually allows so it matches your intent.
- Can you tell me if my content was used to train a model?
- No. We report observed access and readability, not how any vendor uses content.
- Do you audit every article?
- We check your homepage and site-wide files. Access rules in robots.txt apply across the site.
Recommended: Team
Several titles or an editorial and tech team? The Team plan adds seats, more sites and scheduled monitoring.
$199/month · or start with a free check