{"slug": "show-hn-agentsproof-a-small-project-for-testing-ai-agents", "title": "Show HN: AgentsProof – a small project for testing AI agents", "summary": "AgentsProof, a new open-source project, launched a testing framework for AI agents that captures traces, grades them against custom rules, and generates shareable proof reports. The tool integrates via a single SDK call and supports Node and edge runtimes, aiming to catch regressions in agent behavior caused by prompt changes.", "body_md": "A few SDK calls capture your agent's trace, grade it against your custom rules and approved test cases, and create a shareable proof report — in minutes.\n\nYou changed a prompt. Something broke. A user noticed first.\n\n``` js\nimport { AgentsProof } from 'agentsproof';\n\nconst ap = new AgentsProof({ apiKey: process.env.AGENTSPROOF_API_KEY });\nconst run = ap.startRun({\n  projectSlug: 'my-agent',\n  input: { query },\n  goal: 'Search the web and return a working code solution', // anchors grading\n});\n\nconst result = await run.trace('llm_call', 'gpt-4o', () => llm(query));\nconst { publicUrl } = await run.complete({ answer: result });\n\nconsole.log(publicUrl); // → https://agentsproof.dev/r/abc123\n```\n\nOne package, zero config. Works in any Node or edge runtime.\n\nDrop run.trace() around each LLM and tool call. That's the whole integration.\n\nWrite rules in plain English — the LLM checks every run against them automatically.\n\nTurn a passing run into a live test spec. Set success criteria, trace assertions, and expected behavior — all evaluated on every future run.\n\nOne SDK call runs all approved Goldens through your agent. The report shows per-criterion pass/fail for every case — not just an overall score.\n\n``` js\nimport { AgentsProof } from 'agentsproof';\n\nconst ap = new AgentsProof({ apiKey: process.env.AGENTSPROOF_API_KEY });\nconst run = ap.startRun({\n  projectSlug: 'my-agent',\n  input: { query },\n  goal: 'Search the web and return a working code solution', // anchors grading\n});\n\nconst result = await run.trace('llm_call', 'gpt-4o', () => llm(query));\nconst { publicUrl } = await run.complete({ answer: result });\n\nconsole.log(publicUrl); // → https://agentsproof.dev/r/abc123\n```\n\nDefine what 'good' means for your agent in plain English. Every run is automatically graded against your rules — pin specific graders to individual Goldens for targeted enforcement.\n\nTurn any passing run into an executable test spec with success criteria, expected behavior, and trace assertions. Pass goldenId directly to startRun() to run against a Golden on demand — or batch them all in a proof suite.\n\nStructured checks that run deterministically — no LLM needed. If your agent skips a required step or exceeds a step budget, the case fails immediately. Catches regressions the LLM judge can miss.\n\nAgentsProof uses AI to generate edge-case variants from your Goldens, growing your test suite without writing tests by hand.\n\nOne SDK call runs all approved Goldens through your agent. The report shows per-criterion Golden checks alongside the 5-axis score — every pass and fail is explainable.\n\n``` js\nimport { AgentsProof } from 'agentsproof';\n\nconst ap = new AgentsProof({ apiKey: process.env.AGENTSPROOF_API_KEY });\n\nawait ap.runProofSuite({\n  projectSlug: 'my-agent',\n  suiteSlug: 'core-behaviors',\n  async handler(input, ctx) {\n    // input comes from the approved Golden\n    const run = ctx.startRun();\n    const result = await myAgent(input);\n    await run.complete({ answer: result });\n  },\n});\n// → https://agentsproof.dev/p/suite-abc123\n```\n\n~ partial support · based on publicly available information", "url": "https://wpnews.pro/news/show-hn-agentsproof-a-small-project-for-testing-ai-agents", "canonical_source": "https://www.agentsproof.dev/", "published_at": "2026-07-13 20:23:14+00:00", "updated_at": "2026-07-13 20:35:14.949243+00:00", "lang": "en", "topics": ["ai-agents", "developer-tools", "ai-tools"], "entities": ["AgentsProof"], "alternates": {"html": "https://wpnews.pro/news/show-hn-agentsproof-a-small-project-for-testing-ai-agents", "markdown": "https://wpnews.pro/news/show-hn-agentsproof-a-small-project-for-testing-ai-agents.md", "text": "https://wpnews.pro/news/show-hn-agentsproof-a-small-project-for-testing-ai-agents.txt", "jsonld": "https://wpnews.pro/news/show-hn-agentsproof-a-small-project-for-testing-ai-agents.jsonld"}}