Know exactly which AI agents can read your content

Publishers need a deliberate stance on AI crawlers. See which assistants your robots.txt allows, which actually reach your pages, and whether your articles are citable when they do.

Why publishers need a clear view

Robots rules, CDN bot protection and paywalls interact in ways that are hard to see. Many sites block agents they meant to allow, or allow ones they meant to block.

An intentional access policy

Per-agent robots.txt rules that match your licensing and traffic decisions.

Citable articles

Clear headlines, authors, dates and Article markup so content can be attributed correctly.

Readable text

Article copy present in the HTML rather than loaded behind scripts.

What the audit checks for you

  • robots.txt policy per AI agent alongside the observed homepage request result
  • Citability signals: headings, authorship, publication dates and Article markup
  • Readable content in the raw HTML versus the browser view
  • Site identity and Organization details
  • Scheduled monitoring that flags when agent access changes

We check your homepage and site-wide public files, not every page or real assistant answers. Incomplete checks stay clearly marked.

Article · Example publication

How cities are rethinking transit

  • AuthorA. Writer
  • PublishedDated in markup
  • Body textIn the HTML
  • Agent policySet per agent

Someone asks: “Who wrote this, and when?”

Headline, author and date can be attributed.

Illustrative example with fictional details — what an AI assistant needs to read on a site like yours.

Common questions

Do you recommend allowing or blocking AI crawlers?
That's your decision. We show what your current setup actually allows so it matches your intent.
Can you tell me if my content was used to train a model?
No. We report observed access and readability, not how any vendor uses content.
Do you audit every article?
We check your homepage and site-wide files. Access rules in robots.txt apply across the site.

Recommended: Team

Several titles or an editorial and tech team? The Team plan adds seats, more sites and scheduled monitoring.

$199/month · or start with a free check