{"slug": "monitor-llm-costs-with-prometheus-grafana-without-a-proxy", "title": "Monitor LLM Costs with Prometheus & Grafana (Without a Proxy)", "summary": "LLMeter, an open-source tool, enables developers to monitor LLM costs in Prometheus and Grafana without routing traffic through a proxy. By exposing a /metrics endpoint, it allows Prometheus to scrape cost data directly, integrating LLM spending into existing observability dashboards. The tool emphasizes async, out-of-band monitoring to avoid adding latency or points of failure.", "body_md": "PLATAFORMA: Dev.to\n\nIf you're running any observability stack, you've probably got Prometheus and Grafana at the core. You've got your CPU usage, your memory, your network I/O... but what about your single biggest, most volatile line item? Your LLM bill.\n\nGetting that data into your existing dashboards is a pain. Most solutions want you to route all your traffic through their proxy, adding a point of failure and latency you don't need.\n\nIt doesn't have to be that complicated.\n\nI'm a big believer in async, out-of-band monitoring. Your app should fire and forget logging events, not wait for a monitoring service to respond. This is why when I built LLMeter, I made sure it could plug into the tools you already use.\n\nHere's how you can pipe your LLM costs into Prometheus without a proxy.\n\nLLMeter exposes a `/metrics`\n\nendpoint that Prometheus can scrape, just like it does for your other services. All you need to do is add a new job to your `prometheus.yml`\n\n:\n\n```\nscrape_configs:\n  - job_name: 'llmeter'\n    scrape_interval: 15s\n    static_configs:\n      - targets: ['your-llmeter-instance.local:3000']\n```\n\nThat's it. Now you can build Grafana dashboards that show your LLM costs right next to your other metrics. You can see how a spike in traffic to a certain endpoint correlates with a spike in your Anthropic bill. You can finally see the *real* cost of that new AI feature you just shipped.\n\nThis approach gives you:\n\nStop flying blind. Your LLM bill is part of your infrastructure cost. It's time to start treating it that way.", "url": "https://wpnews.pro/news/monitor-llm-costs-with-prometheus-grafana-without-a-proxy", "canonical_source": "https://dev.to/amedinat/monitor-llm-costs-with-prometheus-grafana-without-a-proxy-2gcm", "published_at": "2026-08-03 14:07:58+00:00", "updated_at": "2026-08-03 14:14:05.921378+00:00", "lang": "en", "topics": ["developer-tools", "mlops", "artificial-intelligence"], "entities": ["LLMeter", "Prometheus", "Grafana", "Anthropic"], "alternates": {"html": "https://wpnews.pro/news/monitor-llm-costs-with-prometheus-grafana-without-a-proxy", "markdown": "https://wpnews.pro/news/monitor-llm-costs-with-prometheus-grafana-without-a-proxy.md", "text": "https://wpnews.pro/news/monitor-llm-costs-with-prometheus-grafana-without-a-proxy.txt", "jsonld": "https://wpnews.pro/news/monitor-llm-costs-with-prometheus-grafana-without-a-proxy.jsonld"}}