cd /news/artificial-intelligence/i-built-a-tool-to-check-what-ai-agen… Β· home β€Ί topics β€Ί artificial-intelligence β€Ί article
[ARTICLE Β· art-43930] src=dev.to β†— pub= topic=artificial-intelligence verified=true sentiment=Β· neutral

I built a tool to check what AI agents actually understand about your website

A developer built Lagotto Meter, a tool that checks how well a website's structured data (llms.txt, JSON-LD) supports its claims for AI agents. It fetches declared data, passes it to Llama 3.3 70B or Gemini 2.5 Flash, and scores coherence and completeness. The tool is free and available at lake8.dev/lagotto-meter.

read1 min views1 publishedJun 29, 2026

There's a gap between what a website says about itself and what an AI agent can actually verify from its structured data.

I got curious about this after noticing that different LLMs were giving inconsistent answers about the same company. Some hallucinated services that didn't exist. Others missed the core business entirely. The common thread: the sites had no llms.txt, incomplete JSON-LD, or structured data that contradicted the homepage copy.

So I built Lagotto Meter β€” it fetches llms.txt, llms-full.txt, and JSON-LD from any URL, passes them to Llama 3.3 70B (or Gemini 2.5 Flash as fallback), and scores how well the structured data supports the claims the site makes about itself.

It's not an SEO tool. It doesn't crawl content. It only reads what you've explicitly declared for AI agents β€” and checks whether those declarations are coherent and complete.

The scoring is:

llms.txt presence and quality: 0–25

llms-full.txt: 0–15

JSON-LD [@graph](https://dev.to/graph) completeness: 0–20

robots.txt / sitemap: 0–10

Semantic coherence (LLM judgment): 0–30 Sites with perfect technical structure but no verifiable claims about clients or results get penalized on coherence. The model is looking for proportionality between what you declare and what you can prove.

Try it on your own site or any site you're curious about:

[https://lake8.dev/lagotto-meter](https://lake8.dev/lagotto-meter)

Prompt is public and replicable. Free, 1 analysis per IP per 24h.

── more in #artificial-intelligence 4 stories Β· sorted by recency
── more on @lagotto meter 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain β€” perfect for shipping the agent you just read about.

$git push zahid main
β†’ Live at https://your-agent.zahid.host βœ“
Get free account β†’ Pricing
from €0/mo Β· no card required
LIVE [news/i-built-a-tool-to-ch…] indexed:0 read:1min 2026-06-29 Β· β€”