A developer guide evaluates five LLM routing tools—Bifrost, LiteLLM, Kong AI Gateway, Cloudflare AI Gateway, and OpenRouter—for directing inference requests across multiple model providers to avoid ra…
Maxim AI's Bifrost, an open-source AI gateway written in Go, leads a 2026 comparison of model routing tools, adding only 11 microseconds of overhead at a sustained 5,000 requests per second. The guide…
BerriAI released Litespeed, a local coding agent for the terminal and browser built around multi-model workflows, distributed as a macOS package with runtimes included so no Node or npm setup is requi…
Wiz Research found that a one-character Bearer token ("Bearer a") bypassed authentication in LiteLLM's Model Context Protocol gateway, tracked as CVE-2026-59822, after 90 days of honeypots mimicking A…
OmniRoute, an MIT-licensed self-hosted AI gateway from developer diegosouzapw, routes coding-agent sessions across 352 providers — including 150+ free ones — from a single OpenAI-compatible endpoint a…
A security measurement found 33,005 internet-reachable LiteLLM gateway instances following CVE-2026-59822, an authentication bypass in LiteLLM's MCP Streamable HTTP endpoint that was fixed in version …
A critical authentication bypass in LiteLLM's MCP Streamable HTTP endpoint, tracked as CVE-2026-59822, allowed unauthenticated callers to list and invoke gateway-configured MCP tools by sending a forg…
Security researchers disclosed CVE-2026-48710, dubbed BadHost, an authentication bypass in the Starlette ASGI framework caused by inconsistent parsing of malformed Host headers. The flaw, affecting St…
A developer argues that self-hosting an AI code reviewer is fundamentally a model-placement decision rather than a tooling choice, distinguishing three distinct setups: hosted model with self-hosted a…
Maxim AI has developed Bifrost, an open-source AI gateway written in Go that decouples application logic from LLM provider endpoints through automated routing, load balancing, and governance. A survey…
A developer built Go-Ai, a small open-source HTTP gateway written in Go that gives application backends a single stable endpoint for chat-completion requests while handling provider-facing details lik…
Hudson Rock published an analysis of a 153GB exfiltration archive containing 433,909 files stolen during the March compromise of the litellm package on PyPI, attributing 118,829 CI runner dumps to 2,4…
AT&T cut its coding AI costs by up to 56 percent by adopting task-aware LLM gateway routing, according to a production case study that also cites fintech company Ramp's experience scaling AI features …
A security analysis found that nearly one in ten internet-facing LiteLLM gateways were running with the literal example admin key 'sk-1234' from the documentation still active, exposing provider API k…
A 2026 guide details how LLM model routing middleware can cut API costs by 40–85% without measurable quality loss by dispatching each request to the most suitable model. It outlines three architectura…
A developer released Mohdel 1.0.0, an MIT-licensed self-hosted LLM gateway and SDK for Node that unifies access to Anthropic, OpenAI, Gemini, Mistral, Groq, xAI, Cerebras, Fireworks, DeepSeek, Qwen Cl…
A developer released Tollgate v0.2.3, an open-source LLM gateway that now models long-context pricing tiers, where providers like Google re-rate an entire request at higher rates once a prompt crosses…
A user detailed a home AI inference rig built on an AMD Epyc Rome 7532 CPU with 128GB DDR4, roughly 5TB of NVMe storage, and 4x AMD V620 GPUs on an open-air crypto-mining bench. The rig runs a LiteLLM…
A developer published a Show HN list of seven projects featuring embedded demos, including Bifrost, an enterprise AI gateway the poster claims is 50x faster than LiteLLM with adaptive load balancing, …
Teams building AI features should architect for portability now because current AI service pricing is heavily subsidized and will eventually rise, according to an analysis of AI vendor lock-in. The an…