{"slug": "every-ai-system-has-two-architectures-the-diagram-and-the-invoice", "title": "Every AI System Has Two Architectures — the Diagram and the Invoice", "summary": "Every AI system has two architectures — the one on the whiteboard and the one on the invoice, according to a post in the \"FinOps for Production AI\" series. The author highlights OpenCost as an underused CNCF project that helps close the gap between designed systems and actual costs, noting that cost attribution transforms teams when they first see their own numbers.", "body_md": "Member-only story\n\n# Every AI System Has Two Architectures — the Diagram and the Invoice\n\n*Part of the ongoing “FinOps for Production AI” series.*\n\n## Background\n\nI’ve spent most of this series on the operational surfaces nobody puts on the whiteboard: cost per inference, attribution for agent workloads, the hidden invoice behind probabilistic retrieval. This post is about the gap those pieces keep circling — the gap between the system you designed and the system you pay for.\n\nEvery AI system has two architectures. The first is the one in the diagram: the tidy boxes and arrows, the inference gateway, the batch pipeline, the GPU pool with sensible labels. The second is the one on the invoice — and it never looks like the diagram. On the invoice there’s a namespace nobody remembers creating, a GPU node that’s been warm since March, and a batch worker that costs more per month than the feature it supports.\n\nI was reminded how good the open tooling for closing that gap has gotten while reading a recent CNCF projects roundup — OpenCost has quietly become one of the most underused projects in the ecosystem, and it’s the one I want to dig into here. Because the interesting thing about cost attribution isn’t the dashboards. It’s what happens to a team the first time they see their own number.", "url": "https://wpnews.pro/news/every-ai-system-has-two-architectures-the-diagram-and-the-invoice", "canonical_source": "https://pub.towardsai.net/every-ai-system-has-two-architectures-the-diagram-and-the-invoice-dce04a98db56?source=rss----98111c9905da---4", "published_at": "2026-07-21 20:01:01+00:00", "updated_at": "2026-07-21 20:18:40.593382+00:00", "lang": "en", "topics": ["artificial-intelligence", "ai-infrastructure", "mlops", "developer-tools"], "entities": ["OpenCost", "CNCF"], "alternates": {"html": "https://wpnews.pro/news/every-ai-system-has-two-architectures-the-diagram-and-the-invoice", "markdown": "https://wpnews.pro/news/every-ai-system-has-two-architectures-the-diagram-and-the-invoice.md", "text": "https://wpnews.pro/news/every-ai-system-has-two-architectures-the-diagram-and-the-invoice.txt", "jsonld": "https://wpnews.pro/news/every-ai-system-has-two-architectures-the-diagram-and-the-invoice.jsonld"}}