{"slug": "i-built-a-creator-engine-that-extracts-promises-from-sales-conversations-80", "title": "I built a Creator Engine that extracts promises from sales conversations (80% accuracy)", "summary": "A developer built the Creator Engine, an LLM-based system that compares promises made in sales conversations against actual contract terms, reporting roughly 80% accuracy on a 20-case Promise Alignment Benchmark v0. The architecture follows a strict rule that the LLM only extracts while deterministic engine-level invariant checks decide outcomes, yielding zero invariant violations across all benchmark cases after three prompt iterations. The project is published as a benchmark repo on GitHub and is intended to power five planned products sharing a common Comparison Intelligence core.", "body_md": "Last week I built 32 MCP servers. Today I want to share the more ambitious project: the Creator Engine — a system that compares what sales promises to what the contract actually says.\n\nSales teams promise things. Contracts specify things. They don't always match.\n\nEach mismatch is potential revenue loss, legal exposure, or customer churn. Traditional CLM tools are expensive ($50K+/yr), heavy, and focus on drafts — not on reality alignment.\n\nPromise Alignment Benchmark v0 — an executable specification for testing the engine.\n\ncreator-engine/benchmarks/promise-alignment/v0/ contains:\n\nCover:\n\nHARD FAILURE — 19/20 = FAIL if any invariant breaks.\n\nThree-step LLM pipeline:\n\nThen engine-level invariant checks run on top. For example:\n\nfunction runInvariants(promises, terms, alignments) {\n\nconst violations = [];\n\nfor (const p of promises) {\n\nif (p.status === \"NOT_COMMITMENT\") {\n\nviolations.push({ id: \"INV-004\", reason: \"NOT_COMMITMENT promise\" });\n\n}\n\n}\n\nfor (const a of alignments) {\n\nif (a.relationship === \"CONFLICT\" && !a.reasoning) {\n\nviolations.push({ id: \"INV-001\", reason: \"CONFLICT without reasoning\" });\n\n}\n\nif (a.impact && a.impact.amount != null && !a.impact.calculation_id) {\n\nviolations.push({ id: \"INV-002\", reason: \"amount without calculation_id\" });\n\n}\n\n}\n\nreturn violations;\n\n}\n\nArchitectural rule: LLM extracts, engine decides. Never LLM to final truth.\n\nAfter 3 prompt iterations:\n\nZero invariant violations across all 20 cases.\n\nFailures that remain are mostly edge cases where ground truth is debatable:\n\nThis is expected. 80% is a baseline, not production. Next: multi-step pipeline + verification layer (Phase 42).\n\nGitHub: Alex-Dev-Web-C-DE/creator-engine\n\nNot on npm yet — it's a benchmark repo, not a package.\n\nThe engine will power 5 products: Sales Promise Tracker, ScopeGuard, InvoiceGuard, DeliveryGuard, RevenueLeak.\n\nAll share the same core: Comparison Intelligence.\n\nWhile the engine matures, you can try the live MCP servers: 35 servers on MCPize — validators, parsers, extractors.\n\nMost relevant for the engine use case:\n\nAll x402: agents pay USDC on Base, no signup, no API keys.\n\nWhat's your take? Is 80% good enough to ship a human-in-the-loop MVP, or should I push for 90%+ before any customer touches it?", "url": "https://wpnews.pro/news/i-built-a-creator-engine-that-extracts-promises-from-sales-conversations-80", "canonical_source": "https://dev.to/alexcodebytes/i-built-a-creator-engine-that-extracts-promises-from-sales-conversations-80-accuracy-3h1f", "published_at": "2026-10-02 14:30:06+00:00", "updated_at": "2026-10-02 14:38:18.305295+00:00", "lang": "en", "topics": ["ai-agents", "large-language-models", "ai-tools", "agent-protocols", "developer-tools"], "entities": ["Creator Engine", "Promise Alignment Benchmark v0", "MCPize", "Base", "USDC", "GitHub", "Sales Promise Tracker", "ScopeGuard"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/i-built-a-creator-engine-that-extracts-promises-from-sales-conversations-80", "markdown": "https://wpnews.pro/news/i-built-a-creator-engine-that-extracts-promises-from-sales-conversations-80.md", "text": "https://wpnews.pro/news/i-built-a-creator-engine-that-extracts-promises-from-sales-conversations-80.txt", "jsonld": "https://wpnews.pro/news/i-built-a-creator-engine-that-extracts-promises-from-sales-conversations-80.jsonld"}}