Glad Labs fixed a GPU pinning issue where LiteLLM 1.89.2's global api_base override prevented per-model routing, causing vision tasks to cold-load onto the wrong GPU. The team also hardened content gu…
Autosynth, a new open-source tool for generating synthetic datasets using an LLM loop that proposes, audits, solves, and judges its own work, has been released. Inspired by Meta FAIR's Autodata paper,…
A teenage hacking group called TeamPCP poisoned two releases of LiteLLM, an open-source AI gateway tool downloaded 95 million times, stealing over 500,000 credentials and 300 GB of data from more than…
Six AI agent SDKs—LangGraph, CrewAI, Google ADK, and others—are compared for enterprise Kubernetes deployment, with most being model-agnostic and containerizable for on-premise use, though Anthropic's…
Researchers at Zenity documented three campaigns between March and May 2026 where attackers hijacked exposed LLM endpoints from Ollama and LiteLLM instances to run offensive AI operations. The attacks…
On March 24, 2026, attackers compromised LiteLLM's CI/CD pipeline and uploaded malicious PyPI packages that stole credentials from environments with three million daily downloads. The incident highlig…
Zenity Labs revealed that attackers are weaponizing AI infrastructure, targeting exposed model gateways and unmanaged LLM endpoints. The firm's sensors detected thousands of real-world attacks, includ…
A developer warns that HTTP 200 responses from LLM gateways do not guarantee correct output, as gateways like LiteLLM, Portkey, and OpenRouter only check transport-level success. The developer propose…
Smolagents, a Python library from Hugging Face for building AI agents, prioritizes code-based actions over JSON tool calls, enabling loops, conditionals, and tool composition. However, this design shi…
A developer used agentic AI to decompile a Chinese label printer's Android app and create a Go script that prints PDFs via Bluetooth on Linux, after struggling with poor print quality under CUPS. The …
On June 12, the US government ordered Anthropic to disable Fable 5 globally within six hours, leaving developers without access and highlighting the risk of regulatory takedowns. The following day, GP…
A developer benchmarked four AI gateways—GoModel, LiteLLM, Portkey, and Bifrost—on runtime and deployment overhead. GoModel, a small open-source gateway written in Go, showed significantly lower memor…
A developer outlines five critical observability requirements for production AI agents: full decision path, tool invocation details, per-step cost attribution, session context across restarts, and fai…
A developer built a policy-as-code evaluation pipeline for airline and transport chatbots using LiteLLM and Microsoft ASSERT. The system tests LLM assistants against structured policy scenarios before…
Oracle Cloud announced native support for LiteLLM as a provider for OCI Generative AI Infrastructure, enabling developers to route requests to OCI-hosted models through LiteLLM's gateway with built-in…
LiteLLM launched the Lite-Harness SDK, enabling developers to swap between AI agent harnesses such as Claude Code and Codex without rewriting application code. The SDK provides a unified query interfa…
OpenClaw-memgpt, a new plugin for the OpenClaw agent framework, implements MemGPT's three-tier memory architecture—core, recall, and archival memory—to provide persistent, searchable memory across ses…
Developer Lore released Wayfinder, an open-source LLM router that determines whether to send a prompt to a local or cloud model by analyzing structural features like length, headings, and code, withou…
An engineer at LiteLLM reveals five cost traps in AI API gateways that can silently inflate bills, including retry logic that multiplies API calls across fallback chains and misconfigured fallbacks th…
The U.S. Department of Commerce's ban on Anthropic's Claude Fable 5 and Mythos 5 models over autonomous zero-day discovery concerns is counterproductive for cloud security, according to a cloud engine…