LayoutLens, an AI-powered visual UI testing tool, catches layout and accessibility bugs using deterministic axe-core and geometry checks that run keyless and free in CI, with an optional vision-LLM ti…
NeuralTrust has released TrustGate, an open-source, security-first Agent Gateway written in Go that sits between applications and LLM APIs or MCP tool servers. It provides centralized policy enforceme…
Myli, a provider-neutral, pre-alpha Python harness for agents that propose RFC 6902 changes to application-owned JSON design documents, has been released. The harness never persists or applies returne…
AT&T reduced its AI coding costs by 56% with only a 2% decline in performance by routing routine employee queries to cheaper open-source models via LiteLLM, processing 45 billion tokens daily on its i…
Google Cloud announced four principles for building AI agents that delegate effectively, based on research from Google DeepMind's study 'Intelligent AI Delegation'. The principles include contract-fir…
Stripe is acquiring AI gateway startup OpenRouter for over $7 billion, and Ramp opened its internal router to the public on router.com, claiming a 30% cut in its own LLM costs. Fireworks launched Nexu…
Stwipe, a parody site credited to Duckbill and shitposting.ai, launched August 20 as a fake acquisition of OpenWouter, a fictional Dutch man named Wouter, mocking Stripe's August 19 agreement to acqui…
Ornith-1.0, a June 2026 open-weight coding model, claims to learn by building its own harness during training, and its 9B model matches or beats Gemma4-31B on SWE-Bench Verified and Terminal-Bench 2.1…
On March 24, 2026, malicious versions of the LiteLLM library (1.82.7 and 1.82.8) were hosted on the Python Package Index (PyPI) for approximately 40 minutes by threat actor Team PCP, exfiltrating 78,3…
Boards are now pressing startups on AI vendor concentration risk, asking founders to prove their business isn't dependent on a single model provider. OpenAI's August 2025 GPT-5 rollout briefly cut off…
HarnessRouter, a new open-source tool, provides a canonical API to switch between agent harnesses like Claude Code, Codex, and Hermes, using the Unified Harness Protocol (UHP) to standardize request/r…
A new guide from an unnamed author details how to run Qwen locally on Windows and access it remotely from any device using Ollama, LiteLLM Proxy, and Tailscale. The setup was tested with a Qwen 3.5 9B…
Zalando SE, a European e-commerce company, reported that its LiteLLM-based API proxy, deployed in January 2024, now serves 2,000 monthly active users with just six small pods, and its custom CLI tool,…
A dev.to write-up describes a setup where Claude Code is routed through a LiteLLM proxy to cheaper DeepSeek models via OpenRouter, a pattern that trades away data governance and supply-chain security.…
A developer has built a dual-backend setup for Claude Code, routing cheaper tasks through a self-hosted LiteLLM proxy to DeepSeek models while keeping a full Anthropic subscription for trusted work. T…
Anthropic's Claude Code can now run on-premises with AMD Instinct GPUs, serving GLM 5.2 at full quality via SGLang and LiteLLM, eliminating cloud API dependency and per-token costs. The setup uses an …
In benchmarks comparing proxy overhead, agentgateway 1.4.0 achieved 35,502 QPS with 0.863 ms P50 latency, while LiteLLM 1.98.0's Rust mode achieved 984 QPS with 32.139 ms P50 latency, making agentgate…
AI coding tools now generate 42% of committed code, projected to reach 65% by 2027, yet the security pass rate has stalled at 55% since 2023, according to Veracode's July 2026 GenAI Code Security Repo…
The TeamPCP campaign in March 2026 used a stolen token to cascade across five ecosystems in eight days, publishing backdoored LiteLLM versions 1.82.7 and 1.82.8 on PyPI that swept LLM API keys, cloud …
DSPy 3.3.0's MIPROv2 optimizer can automatically compile a support-ticket classifier prompt that beats a hand-tuned baseline, according to a tutorial by Mariana Souza. The approach uses a DSPy signatu…