cd /news/ai-infrastructure/every-team-wants-ai-then-three-quest… · home › topics › ai-infrastructure › article
[ARTICLE · art-173728] src=dev.to ↗ pub= topic=ai-infrastructure verified=true sentiment=↑ positive

Every team wants AI. Then three questions arrive: What does it cost? Where are the keys? Can we stop it?

A platform engineer built SanVi, an OpenAI-compatible AI gateway on Kubernetes powered by the LiteLLM engine, to give teams a single endpoint that answers three operational questions: what AI usage costs, where API keys are held, and whether requests can be stopped. The project centralizes model access and control for applications consuming AI services.

key takeaway

SanVi routes app traffic through one OpenAI-compatible LiteLLM endpoint on Kubernetes, centralizing cost tracking, key management and the ability to halt AI requests.

by read1 min views2 publishedNov 21, 2026
Every team wants AI. Then three questions arrive: What does it cost? Where are the keys? Can we stop it?
Image: Dev.to

sandhil kypa Posted on

Every team wants AI. Then three questions arrive: What does it cost? Where are the keys? Can we stop it?

I'm a platform engineer, and I built SanVi to answer all three on Kubernetes.

The gateway #

Apps call one OpenAI-compatible endpoint (LiteLLM engine

── more in #ai-infrastructure 4 stories · sorted by recency
── more on @sanvi 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/every-team-wants-ai-…] indexed:0 read:1min 2026-11-21 · —