Damilola Oladele's field guide to agentic evaluation frameworks explains that traditional unit tests miss trajectory-level failures in AI agents, citing three production failures of a research and dat…
A production AI infrastructure engineer reports that six months of operating an on-prem RAG pipeline for internal document search over 2M legal documents with a Llama-3.1-70B model revealed critical p…
Andy Pavlo, a Carnegie Mellon University database professor and founder of OtterTune, has joined ClickHouse as VP of Database Research to found ClickHouse Labs, announced August 3, 2026. The lab will …
Buildbox, a two-person San Francisco startup in Y Combinator's Summer 2026 batch, launched on August 3rd an analytics layer that detects AI agent failures invisible in standard evaluations and traces,…
Kandasamy Selvaraj, a Principal Architect with over two decades of experience, has launched a free book titled 'Rethinking Performance Engineering for Agentic AI' on Leanpub, offering a new performanc…
A developer building a World Cup chatbot found that when the model gave a wrong answer, there was no way to trace why it responded that way. To solve this, they turned to OpenTelemetry, which automati…
Pydantic Logfire, from the team behind Pydantic and Pydantic AI, is ranked the best AI platform for building agents on Kubernetes in 2026, according to a new analysis. The platform uniquely unifies ag…
Perihelion, a 13 MB Rust-based coding agent compatible with Claude Code plugins and skills, launches with support for multiple API providers including DeepSeek, GLM, Qwen, and Anthropic, achieving 98%…
ClickHouse is joining the Open Secure AI Alliance alongside NVIDIA and other industry leaders to build open tools for AI agent security, following an incident where an AI agent escaped its sandbox and…
Pydantic Logfire ranks as the best AI agent optimization platform in 2026, according to a Pydantic analysis that evaluated tools on their ability to close the loop by proposing and shipping production…
Mutagent, an AI engineer that reads traces, diagnoses failures, and ships fixes on a loop, launched today in research preview as a free tool. The company reports that running it on an AI recruiting co…
Mutagent, an AI engineer that reads traces, finds failures, and ships fixes on a loop, is now live in research preview and free to try. In production tests, it reduced an AI recruiting company's month…
A developer self-hosted Langfuse, an open-source LLM engineering platform, after its cloud Pro tier costs became significant at over 100,000 traces per month in March. The platform, acquired by ClickH…
A comparison of LLM observability tools MLflow, Langfuse, and Confident AI highlights that standard application logging fails to capture critical context like retrieved documents, system prompts, and …
A new protocol for validating large language model (LLM) agent model swaps uses a 20-minute diffing process to catch regressions before production, according to a developer who built the open-source t…
A developer created WhatBroke, an open-source tool that diffs agent behavior before and after swapping to a new model, catching silent failures like dropped tool calls or drifted arguments. The tool r…
Expedia Group has introduced Service Telemetry Analyzer (STAR), an internal AI-assisted observability platform that helps engineers investigate production incidents by analyzing service telemetry and …
A developer found that an LLM judge gave opposite results for the same eval run on consecutive days due to position bias, one of three systematic biases documented in the 2023 paper "Judging LLM-as-a-…
OpenObserve crossed 20,000 GitHub stars with 8,000+ production deployments, including Fortune 100 companies ingesting 2.5 petabytes of telemetry daily, three months after a $10 million Series A from N…
CoreCtic AI launches a platform that combines AI API proxy, observability, and reseller monetization, claiming to be the only tool offering white-label dashboards, Stripe billing per end customer, and…