{"slug": "every-team-wants-ai-then-three-questions-arrive-what-does-it-cost-where-are-the", "title": "Every team wants AI. Then three questions arrive: What does it cost? Where are the keys? Can we stop it?", "summary": "A platform engineer built SanVi, an OpenAI-compatible AI gateway on Kubernetes powered by the LiteLLM engine, to give teams a single endpoint that answers three operational questions: what AI usage costs, where API keys are held, and whether requests can be stopped. The project centralizes model access and control for applications consuming AI services.", "body_md": "[sandhil kypa](https://dev.to/sandhil_kypa_b7cd7c3d5f39)\n\nPosted on\n\nEvery team wants AI. Then three questions arrive: What does it cost? Where are the keys? Can we stop it?\n\nI'm a platform engineer, and I built SanVi to answer all three on Kubernetes.\n\n## The gateway\n\nApps call one OpenAI-compatible endpoint (LiteLLM engine", "url": "https://wpnews.pro/news/every-team-wants-ai-then-three-questions-arrive-what-does-it-cost-where-are-the", "canonical_source": "https://dev.to/sandhil_kypa_b7cd7c3d5f39/every-team-wants-ai-then-three-questions-arrive-what-does-it-cost-where-are-the-keys-can-we-4682", "published_at": "2026-11-21 10:05:43+00:00", "updated_at": "2026-11-21 10:12:09.136992+00:00", "lang": "en", "topics": ["ai-infrastructure", "large-language-models", "mlops", "ai-tools", "developer-tools"], "entities": ["SanVi", "LiteLLM", "Kubernetes"], "also_reported_by": [], "takeaway": "SanVi routes app traffic through one OpenAI-compatible LiteLLM endpoint on Kubernetes, centralizing cost tracking, key management and the ability to halt AI requests.", "recommendation": null, "alternates": {"html": "https://wpnews.pro/news/every-team-wants-ai-then-three-questions-arrive-what-does-it-cost-where-are-the", "markdown": "https://wpnews.pro/news/every-team-wants-ai-then-three-questions-arrive-what-does-it-cost-where-are-the.md", "text": "https://wpnews.pro/news/every-team-wants-ai-then-three-questions-arrive-what-does-it-cost-where-are-the.txt", "jsonld": "https://wpnews.pro/news/every-team-wants-ai-then-three-questions-arrive-what-does-it-cost-where-are-the.jsonld"}}