A developer detailed how Langfuse provides the trace/span/generation hierarchy needed to debug multi-step agentic LLM workflows, contrasting it with observability tools that only capture top-level cal…
TokenOps, an open-source system from The Agent Plane, provides real-time, run-scoped cost control for AI agents, addressing the problem of runaway token spend across multi-call runs. Unlike traditiona…
A 32-attempt Claude Code evaluation on August 11, 2026, found that Langfuse was selected in every tracing and production-monitoring task but in none of the prompt comparison and release-gate tasks. Ho…
A developer surveyed the metric catalogs of five widely-used LLM evaluation tools—Arize Phoenix, DeepEval, Future AGI, Langfuse, and Ragas—and found that the built-in metrics are converging into a com…
A developer's analysis of LLM evaluation monitoring reveals that alert thresholds on eval scores are hypothesis tests whose false-alarm rates are often ignored. With 150 judge scores per hour and a 92…
An engineer's analysis reveals that AI agents often fail in production due to compound error rates, with an 8-step agent at 85% per-step reliability yielding only a 27% end-to-end success rate. Citing…
The LLM observability platform market is projected to grow from $1.97 billion in 2025 to $2.69 billion in 2026 and reach $9.26 billion by 2030 at a 36.2% CAGR, according to The Business Research Compa…
Damilola Oladele's field guide to agentic evaluation frameworks explains that traditional unit tests miss trajectory-level failures in AI agents, citing three production failures of a research and dat…
A production AI infrastructure engineer reports that six months of operating an on-prem RAG pipeline for internal document search over 2M legal documents with a Llama-3.1-70B model revealed critical p…
Andy Pavlo, a Carnegie Mellon University database professor and founder of OtterTune, has joined ClickHouse as VP of Database Research to found ClickHouse Labs, announced August 3, 2026. The lab will …
Buildbox, a two-person San Francisco startup in Y Combinator's Summer 2026 batch, launched on August 3rd an analytics layer that detects AI agent failures invisible in standard evaluations and traces,…
Kandasamy Selvaraj, a Principal Architect with over two decades of experience, has launched a free book titled 'Rethinking Performance Engineering for Agentic AI' on Leanpub, offering a new performanc…
A developer building a World Cup chatbot found that when the model gave a wrong answer, there was no way to trace why it responded that way. To solve this, they turned to OpenTelemetry, which automati…
Pydantic Logfire, from the team behind Pydantic and Pydantic AI, is ranked the best AI platform for building agents on Kubernetes in 2026, according to a new analysis. The platform uniquely unifies ag…
Perihelion, a 13 MB Rust-based coding agent compatible with Claude Code plugins and skills, launches with support for multiple API providers including DeepSeek, GLM, Qwen, and Anthropic, achieving 98%…
ClickHouse is joining the Open Secure AI Alliance alongside NVIDIA and other industry leaders to build open tools for AI agent security, following an incident where an AI agent escaped its sandbox and…
Pydantic Logfire ranks as the best AI agent optimization platform in 2026, according to a Pydantic analysis that evaluated tools on their ability to close the loop by proposing and shipping production…
Mutagent, an AI engineer that reads traces, diagnoses failures, and ships fixes on a loop, launched today in research preview as a free tool. The company reports that running it on an AI recruiting co…
Mutagent, an AI engineer that reads traces, finds failures, and ships fixes on a loop, is now live in research preview and free to try. In production tests, it reduced an AI recruiting company's month…
A developer self-hosted Langfuse, an open-source LLM engineering platform, after its cloud Pro tier costs became significant at over 100,000 traces per month in March. The platform, acquired by ClickH…