FinOps, traditionally focused on cloud infrastructure costs, must now account for AI token spend, which behaves differently from conventional cloud costs. The author explains that token usage is meter…
California's Labor Commissioner opened an inquiry within 48 hours after an AI system fired a San Francisco cashier, and Assembly Bill 2930, which would require employers to disclose automated decision…
Repeating an instruction in a system prompt improves compliance up to four repetitions, after which gains plateau, according to a test by an unnamed developer on Gemini 2.5 Flash. The experiment, whic…
DeepSeek released DeepSeek Harness v0.1 in developer preview, publishing the full source code under the MIT license at deepseek-ai/deepseek-harness. The harness, built on the Cordis plugin framework, …
Vercel AI Gateway charges zero markup on provider list prices, while OpenRouter adds a 5.5% fee on credit purchases, but OpenRouter offers broader model coverage and more provider redundancy, accordin…
Every engineering leader is asking how to move engineering work to the cloud, with startups seeking to move all of it and enterprises starting with a smaller ask, according to an essay on cloud dev en…
Google accidentally deprecated its Gemini 2.5 Flash and Pro models early, causing widespread production outages for developers who rely on the models. The issue was resolved after about 30 minutes, wi…
Microsoft Entra ID custom security attributes can serve as a governance metadata layer for AI agents, enabling attribute-driven policies instead of manual per-agent management. By defining attributes …
The autoimmune disease therapy market is experiencing a boom, with major developments including OpenAI's healthcare push and Vertex's $10 billion acquisition of Crinetics, signaling significant invest…
Veeam appointed Mika Yamamoto as its new Chief Marketing Officer and Customer AI Officer, replacing Allison Cerra, who left after only four months. Cerra departed to become CMO at Vertex, a smaller ta…
Wyolet released Wyolet Relay, an open-source, self-hosted LLM router that provides a single OpenAI- and Anthropic-compatible endpoint for multiple providers, enabling automatic failover, rate-limit po…
Knotch launched ACE, an AI layer that personalizes customer experiences by analyzing historical data and brand guidelines. Zillow's B2B arm adopted ACE to reduce bounce rates and tailor content for pr…
LiteLLM is a powerful open-source proxy for 100+ LLM providers, ideal for prototyping and small-scale deployments. However, as teams scale to production, they may encounter operational overhead from r…
Developer Matt Coles built lgtmaybe, an open-source PR reviewer that works with OpenAI, Anthropic, OpenRouter, Bedrock, Vertex, or local Ollama models. The tool posts inline comments and summaries on …
Conductor released version 0.62.0 with file-backed settings in TOML format, an experimental browser preview powered by Agentation, and queue improvements with keyboard navigation. The update also intr…
Claude Code versions 2.1.154 through 2.1.158 contain a regression that corrupts the streaming delivery of tool results back to the model, causing results to arrive empty-then-late in bursts, duplicate…
A developer measured a 340% variance between advertised per-token pricing and actual monthly spend across five LLM deployments using identical request volumes. The gap stems from three hidden cost lay…
Conductor released version 0.61.0 with Ultracode, a feature combining x-high effort and dynamic workflow orchestration for Claude, alongside numerous Git improvements and fixes. The update also introd…
Nexus Labs replaced 60% of its 11,247-line Python middleware for per-tenant LLM cost attribution, rate limiting, and provider failover with Bifrost's virtual keys and governance features. The migratio…
A 30-day production test at Nexus Labs compared three AI gateways—Bifrost, LiteLLM, and Portkey—measuring failover latency and overhead. Bifrost added 11ms p99 overhead with automatic provider fallbac…