A developer compared managed multi-provider routers, self-hosted gateways, and thin in-app adapters for property-management moderation, concluding that raw token rates alone cannot determine the cheap…
Tyler Edwards, co-founder and CEO at Overmind, argues that while LLM gateways and observability tools have matured and been acquired, they fail to evaluate whether agent trajectories are actually good…
An AWS Labs sample for evaluating AI agents, Agent-EvalKit, uses the same Anthropic Claude model as both the judge and the subject in its QA example, a design choice that is not disclosed in the repos…
A developer's analysis of thirteen cyber incidents from late 2025 through August 2026 reveals a common failure: attackers exploit valid credentials at machine speed, outpacing human-paced defenses. Th…
Wiz Threat Research reported that over 90 days of honeypot telemetry revealed active attack campaigns targeting AI infrastructure, including LiteLLM, MCP servers, and AI frameworks, with techniques su…
A developer outlined an architectural blueprint for AI FinOps telemetry pipelines that decouple token cost ingestion from the request path using Kafka streaming buffers, idempotency keys, and tenant-s…
AT&T cut the cost of coding and other advanced AI tasks by as much as 56%, with quality declining only 2%, by using the open-source model router LiteLLM and shifting volume to open-weight models, acco…
A new Backstage plugin from @acarmisc provides a governance interface for LiteLLM proxy, enabling developers to manage virtual API keys and monitor AI model usage directly within Backstage 1.50+. The …
InferCrane, an open-source inference operations platform, launched with a stable endpoint for self-hosted AI inference, supporting vLLM, SGLang, LiteLLM, and other OpenAI-compatible endpoints. The Apa…
Australian Federal Police arrested Ruben Ian Thomson, 21, and Louis Michael Gaebler, 23, in Perth on August 26, charging them over TeamPCP, a supply-chain attack that compromised more than 1,000 organ…
A developer detailed how to configure LiteLLM as a gateway for a custom model provider in OpenAI's Codex coding agent. The setup involves setting an environment variable for the API key, adding provid…
Microsoft Security Research has documented attacks targeting AI infrastructure components, including LiteLLM, RAGFlow, and Kestra, which were compromised and abused for credential theft, persistence, …
A Server-Side Request Forgery (SSRF) vulnerability in the ddfourtwo/sentry-selfhosted-mcp repository's raw_sentry_api component, tracked as CVE-2026-81421 with a CVSS score of 7.3 (researchers suggest…
A developer released Z, a minimal agentic coding harness for the terminal that supports 26 providers via LiteLLM, including Z.AI, DeepSeek, Anthropic, OpenAI, Ollama, Bedrock, Copilot OAuth, and OpenR…
InferCrane, an open-source inference operations platform, released v1.0.0-rc.1, a public beta CLI and SDK that deploys, operates, and safely evolves self-hosted AI inference behind a stable OpenAI-com…
A developer built a token-optimization stack for coding agents to reduce API costs, but killed the project after discovering that the savings numbers were misleading and the rigorous benchmark would c…
Stripe agreed to acquire OpenRouter for more than $7 billion on August 19, 2026, its largest acquisition ever, giving the payments company control over the API gateway used by 8 million developers to …
In March 2026, threat actor group TeamPCP published two backdoored versions of LiteLLM (1.82.7 and 1.82.8) to PyPI, live for roughly six hours, compromising more than 2,500 organizations and 434,000 C…
Vyoman Labs released Prism Reviewer, a multi-agent AI code review system built with LangGraph and LiteLLM that splits git diffs into parallel security, design, and code-quality analyses. The tool supp…
NeuralTrust has built TrustGate, an open-source Agent Gateway in Go that provides a single control plane for both model calls and tool (MCP) calls, ensuring consistent identity, audit, budgets, and po…