A developer's blog post argues that the AI developer stack has shifted from model capabilities to production engineering, emphasizing RAG verification checklists, agent observability, and lightweight …
Arize Phoenix now ships a built-in Model Context Protocol (MCP) server that lets coding agents query traces with SQL, reducing average cost by about 17x in an eight-question benchmark. The server prov…
Developer Ashwin Ugale released tracelint, an open-source linter that detects structural defects in AI agent execution traces without using an LLM. The tool reads telemetry from OpenInference, Arize P…
A developer surveyed the metric catalogs of five widely-used LLM evaluation tools—Arize Phoenix, DeepEval, Future AGI, Langfuse, and Ragas—and found that the built-in metrics are converging into a com…
Claude Code agents fail because developers treat them like synchronous code, according to a developer's analysis of execution transcripts. The article identifies three failure modes—silent context ove…
A developer building a World Cup chatbot found that when the model gave a wrong answer, there was no way to trace why it responded that way. To solve this, they turned to OpenTelemetry, which automati…
A new open-source RAG agent combines Qdrant hybrid search (dense + BM25 with RRF fusion), LangGraph ReAct routing with safety overrides, an MCP server for tool exposure, and Arize Phoenix for observab…
Dify, an open-source LLM app development platform, gained 840 GitHub stars and now has 149k stars total. The platform offers a visual builder, RAG pipelines, and agent workflows for teams building LLM…
A new comparison of LLM evaluation frameworks RAGAS, DeepEval, and Promptfoo reveals that the LLM-as-a-judge mechanism they all rely on has measurable biases—position bias, self-preference bias, and v…
Arize Phoenix released evaluation support for Pytest and Vitest/Jest, allowing developers to write LLM evaluations as ordinary tests. The integration records LLM traces and metrics like cost and laten…
InfoQ opened enrollment for its AI Security & Privacy Engineering Program, a five-week online cohort for senior engineers in regulated industries, starting August 26 and October 14. The program, facil…
A new directory catalogs tools and methods for improving the reliability of LLM agents, covering model selection, structured outputs, runtime repair, guardrails, observability, and evaluation. The gui…
SigNoz, Langfuse, and Arize Phoenix lead the top LLM observability tools in 2026, offering capabilities such as full-stack monitoring, agent workflow debugging, and drift detection. The tools converge…
A developer running reliability for a small team shipping LLM features compared six Langfuse alternatives—Helicone, Arize Phoenix, LangSmith, Braintrust, Laminar, and Future AGI traceAI—focusing on bo…
A developer built an open-source PII firewall for LLMs after accidentally sending a customer's credit card number to OpenAI during a benchmark test. The tool, called LLM Governance Engine, intercepts …
A developer evaluated six LLM observability tools—Langfuse, Helicone, Arize Phoenix, LangSmith, Braintrust, and Laminar—for their ability to monitor the audio layer in voice agents, not just LLM calls…
A company shipped an AI chat feature to production but found the model was a black box, unable to answer basic operational questions about why answers were good or bad. The team added an observability…
Arize AI cofounder and CPO Aparna Dhinakaran demonstrated a method for improving AI agents by building a better harness around the model, using traces and evals to debug failures. In a live demo with …
At the AI Conf 2026 in Moscow, the industry has fully shifted away from traditional machine learning toward agents, RAG, and voice systems, with agent orchestration emerging as the new infrastructure …
Arize Phoenix is evolving from an observability tool designed for human-in-the-loop workflows into a context platform for both humans and AI agents. The shift comes as coding agents increasingly write…