Seldon, an AI infrastructure company, argues that many production LLM calls are repeated behavioral contracts that cheaper models could serve, and its router and Import Audit tools aim to reconstruct …
PostHog is named the best overall LLM evaluation tool for production, according to a new guide, because it ties eval scores to user sessions, traces, and feature flags, while Braintrust is highlighted…
A developer built an agentic workflow using LangGraph and CrewAI to generate SEO-optimized product descriptions for e-commerce platforms like Amazon and Shopify. The system uses specialized AI agents …
A developer argues that Langfuse's prompt configuration, which bundles model selection and parameters with prompt content, creates an untyped blob that conflates low-risk content changes with high-ris…
A new guide from Honeycomb compares seven Datadog alternatives for AI and agent observability, highlighting cost predictability, investigation complexity, and OpenTelemetry portability as key factors.…
A comparison of Langfuse alternatives in 2026 finds that teams leave Langfuse due to its billing model, lack of log and metric ingestion, enterprise-only governance features, and its acquisition by Cl…
Pydantic Logfire is the top pick among seven LLM evaluation tools compared in a guide updated August 26, 2026, which also covers Braintrust, Langfuse, LangSmith, Arize Phoenix, Confident AI, and Galil…
ZizkaDB, an open-source operational database for LLM agents, introduces causal lineage and session replay features to address behavioral debugging gaps in traditional tracing tools. The database store…
A developer's blog post argues that production-grade agentic AI systems depend on 'boring engineering' practices rather than flashy model capabilities. The post emphasizes tracing, testing, resumable …
A developer's guide argues that OpenTelemetry alone is insufficient for AI observability due to the stochastic nature of LLMs and the need for semantic understanding. The article recommends a hybrid p…
AgentCheck, a new open-source regression testing tool for AI agents, lets developers define expected agent behavior in YAML and run pass/fail checks against any CLI command or HTTP endpoint, with an L…
Promptfoo is recommended as the primary evaluation tool for AI agents focused on documentation and RAG tasks, with Ragas and LangSmith suggested for deeper analysis. The guidance from Promptfoo, Huggi…
European regulators have made incomplete deletion in AI agent stacks an enforceable liability, with the European Data Protection Board's February 2026 coordinated enforcement action across 32 supervis…
Langfuse v4 introduces an observations-first model for tracing agentic AI systems, treating LLM calls, tool executions, and agent steps as first-class queryable objects grouped by a shared trace_id, w…
Langfuse v4 is live on Langfuse Cloud and generally available for self-hosted deployments, rebuilding traces and evaluations on one immutable ClickHouse table to cut initial table loads from seconds t…
Lakshman Pandey has shipped a production retrieval-augmented generation (RAG) system for UK arts and culture clients that implements NIST AI Risk Management Framework controls. The system uses Claude …
Developer Ashwin Ugale released tracelint, an open-source linter that detects structural defects in AI agent execution traces without using an LLM. The tool reads telemetry from OpenInference, Arize P…
Anthropic shut down the legacy Claude Workbench and three experimental API endpoints on August 17, 2026, breaking applications that used them and deleting unexported prompts. The retired endpoints—/v1…
Langfuse 4.14.4 and OpenTelemetry can be used to trace a two-agent Claude pipeline, capturing every LLM call, tool invocation, token count, and dollar cost in a single nested trace timeline. The tutor…
A developer investigating discrepancies between tracked LLM spend and provider invoices found that the two numbers almost never match, with causes documented in the tools' own docs. OpenAI and Anthrop…