{"slug": "the-ai-feature-is-cheap-to-build-and-expensive-to-run", "title": "The AI Feature Is Cheap to Build and Expensive to Run", "summary": "Shanti Infosoft engineers estimate the ongoing operational costs of AI features, including tokens, retries, retrieval, infrastructure, and human review, and recommend choosing the cheapest model that passes evaluation, caching, and setting hard spend caps. They present both build and monthly running costs to clients to avoid budget surprises.", "body_md": "The quote everyone remembers is the build cost. The number that decides whether an AI feature survives is the monthly one, and it tends to show up in month two, right when the trial credits run dry and real traffic arrives.\n\nI budget AI features the way I'd budget a delivery van. Buying it happens once. Fuel, insurance, and the driver run forever. Here's where the fuel actually hides.\n\nTokens, including the ones you forget. Everyone counts the user's question. Fewer people count the system prompt, the retrieved context, the few-shot examples, and the model's own output, all billed on every call. A feature carrying a 3,000-token context that looked tiny in testing can run 10x the estimate once every request drags that prompt along.\n\nRetries and retrieval. A retry on failure doubles the cost of that call. A RAG feature also pays to embed every document, store the vectors, and run a similarity search per query. The model bill is one line on a longer receipt.\n\nThe machinery around the model. Vector database hosting. Logging and observability, which for AI features is not optional. Egress. The cache you'll add later to stop paying twice for the same answer.\n\nHumans in the loop. If a person reviews flagged outputs, that review time is a running cost of the feature and belongs in the budget, even though no vendor ever invoices you for it.\n\nWe estimate a cost per action before a line of the feature exists. Average tokens in, average tokens out, times the model's price, times expected volume. It's back-of-envelope, and it usually lands close, because the inputs are knowable.\n\nThen we pick the cheapest model that passes evaluation, not the highest one on the leaderboard. A smaller model that's good enough on your real task can cut the bill 5 to 10x. We send the easy 80% of requests to the cheap model and escalate only the hard ones. Caching repeat queries shaves off another slice.\n\nThe last step is a hard spend cap wired in before launch. Per user, per day, per feature. A runaway loop or a scraper pounding your endpoint should trip a limit and page a human, not keep billing until the card declines.\n\nWhen we scope AI work, the client gets both numbers. Build once, and run monthly at your expected volume, with the assumptions written down beside them. A client who signed off on a $600-a-month running cost stays calm when the bill reads $600. A client shown only the build price feels ambushed, and they're right to.\n\nThat conversation is unglamorous, and it's the one that stops a project from souring six weeks in. The team at Shanti Infosoft treats the running-cost estimate as part of the quote, not a thing we discover together later, and you can see how we scope it at [https://shantiinfosoft.com](https://shantiinfosoft.com).\n\nWe break the running-cost math down further in [the automation trade-off nobody quotes you on](https://www.shantiinfosoft.com/blog/automation-trade-off-real-bill/).\n\nWhat did an AI feature actually cost you to run each month, and how far off was the first estimate?", "url": "https://wpnews.pro/news/the-ai-feature-is-cheap-to-build-and-expensive-to-run", "canonical_source": "https://dev.to/sagar_jain4010/the-ai-feature-is-cheap-to-build-and-expensive-to-run-3924", "published_at": "2026-08-04 09:00:18+00:00", "updated_at": "2026-08-04 09:12:14.130940+00:00", "lang": "en", "topics": ["artificial-intelligence", "ai-infrastructure", "mlops", "ai-products"], "entities": ["Shanti Infosoft"], "alternates": {"html": "https://wpnews.pro/news/the-ai-feature-is-cheap-to-build-and-expensive-to-run", "markdown": "https://wpnews.pro/news/the-ai-feature-is-cheap-to-build-and-expensive-to-run.md", "text": "https://wpnews.pro/news/the-ai-feature-is-cheap-to-build-and-expensive-to-run.txt", "jsonld": "https://wpnews.pro/news/the-ai-feature-is-cheap-to-build-and-expensive-to-run.jsonld"}}