Show HN: Inference Stack – Everything you need to own your inference BerriAI released Inference Stack v0.1.2, an open-source package that lets teams run their own model inference by bundling vLLM for GPU serving, LiteLLM for a single API gateway with keys, teams and budgets, and Prometheus-backed dashboards. The stack installs with one curl command on a single machine running Docker Compose, curl and OpenSSL, then serves a launcher at localhost:8080 where an admin signs in with a generated password, picks a model in vLLM, deploys it and sends prompts through the LiteLLM Playground. Real models require NVIDIA GPUs; without one, users can enable simulation in a model's Settings for canned responses, and the LiteLLM router selects a vLLM replica per request using cache and queue data. vLLM Search Hugging Face, check GPU requirements, and deploy from the launcher. vLLM runs the model on your GPUs. vLLM docs https://docs.vllm.ai Everything you need to own your inference. Deploy with one command. For one machine. Requires Docker with Compose, curl, and OpenSSL. Setup details https://www.inferencestack.io/docs docker-compose curl -fsSL https://github.com/BerriAI/inference-stack/releases/download/v0.1.2/install.sh | bash -s -- docker Open localhost:8080 http://localhost:8080 and sign in as admin with the generated password. Choose a model in vLLM , deploy it, then open LiteLLM → Playground to send a prompt. Real models need NVIDIA GPUs. No GPU? Enable simulation in the model’s Settings for canned responses. Send requests through one API. Create keys, manage teams and budgets, or try a model in the Playground. Selects a vLLM replica for each request using cache and queue data. Routing works by default; adjust the weights when you need to. See model health, request traffic, and response times in the included dashboards. Metrics come from Prometheus.