cd /news/large-language-models/llama-dash-local-llm-ops · home topics large-language-models article
[ARTICLE · art-33727] src=dev.to ↗ pub= topic=large-language-models verified=true sentiment=↑ positive

llama-dash - Local LLM Ops

A developer built llama-dash, a dashboard and logging proxy for self-hosted local LLM inference stacks. It proxies OpenAI/Anthropic-compatible endpoints, logs requests with token counts and cost estimates, and adds API key management, rate limits, model allow-lists, and UI-based model control. The tool ships as a Docker Compose stack and can be used with tools like Claude Code.

read1 min views1 publishedJun 19, 2026

I've been building llama-dash, a single-pane dashboard and logging proxy for a self-hosted local inference stack.

I run llama-swap + llama.cpp on a box at home and got tired of having zero visibility — no request log, no idea which model was loaded when, no way to hand out scoped access without exposing the raw backend.

So llama-dash sits in front as one public port: it proxies the OpenAI/Anthropic-compatible /v1/* endpoints unchanged (streaming SSE passes straight through), logs every request with token counts and cost estimates, and adds the stuff llama-swap doesn't have — hashed API keys, per-key rate limits and model allow-lists, routing rules, and model load/unload from the UI.

The bit I like most is that you can point Claude Code at it via ANTHROPIC_BASE_URL and watch your own usage flow through. It ships as a Docker Compose stack with the backend hidden internally.

── more in #large-language-models 4 stories · sorted by recency
── more on @llama-dash 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
Live at https://your-agent.zahid.host
Get free account → Pricing
from €0/mo · no card required
LIVE [news/llama-dash-local-llm…] indexed:0 read:1min 2026-06-19 ·