Developer Ashwin Ugale released tracelint, an open-source linter that detects structural defects in AI agent execution traces without using an LLM. The tool reads telemetry from OpenInference, Arize P…
CrewAI launched Crew Studio, an Automated Agent Builder with native Arize AX tracing and evaluation integration, enabling teams to send traces from the first run without custom instrumentation. The in…
OpenTelemetry released the GenAI Normalizer, a processor for the OpenTelemetry Collector, that translates span attribute labels from LLM instrumentation frameworks such as OpenLLMetry and OpenInferenc…
Arize AX, the AI observability platform from Arize AI, now natively supports OpenTelemetry GenAI semantic conventions, enabling teams to send gen_ai.* telemetry directly over OTLP without custom proce…
Agent Detective, a new open-source evaluation framework for multi-agent systems, identifies the first node where quality breaks in a pipeline by ingesting standard OpenTelemetry traces and rebuilding …
Enprompta launched an evaluation and observability platform for AI teams that traces LLM calls, runs automated evals, and enables prompt iteration in production without redeploying. The platform offer…
A new command-line tool called token-trace-viewer lets developers trace token and dollar costs across sub-agents in a single multi-agent run by reading OpenInference-style JSONL trace files. The Pytho…
An agent skill reduced average latency by 56%, token usage by 27%, and estimated cost by 44%, but also decreased answer completeness. The regression was detected only after tracing both versions in Ar…
SigNoz's open-source LLM observability features (v0.133.0+) require two specific environment variables to be set simultaneously to bypass silent configuration hurdles that prevent dashboards from load…
SigNoz v0.133.0 was deployed via Foundry for AI agent observability, but a developer discovered that the OpenInference instrumentation used by openinference-instrumentation-agno does not follow the st…
SigNoz's LLM observability feature, shipped in v0.133.0, is nearly unreachable due to three silent configuration gates and a bug that prevents processors from being wired into pipelines. A hackathon t…
SigNoz announced support for monitoring DSPy programs via OpenTelemetry, enabling real-time visibility into DSPy module calls and language model requests. The integration uses the OpenInference DSPy i…
A developer built Otterscope, a lightweight observability tool for LLM agents that runs as a single Go binary with SQLite, avoiding the complexity of hosted or multi-service solutions. The tool ingest…
TrueFoundry announced a native integration between its AI Gateway and Arize, enabling enterprises to trace, evaluate, and monitor AI model calls across multiple providers and agent frameworks without …
HALO, an open-source tool for debugging and optimizing AI agents using execution traces, has been released. It uses a Recursive Language Model to analyze traces and find systemic issues, and can optio…
Arize AI released Project Rosetta Stone, a reference implementation that builds the same agent across 22+ frameworks with three observability tiers, enabling engineers to see exactly how to instrument…
SigNoz has released a new guide for enabling observability and monitoring in Python-based LlamaIndex applications using OpenTelemetry, allowing developers to trace AI-specific operations such as docum…
Phoenix, an open-source AI observability project, crossed 10,000 GitHub stars after growing from a Jupyter notebook extension in 2023 into a widely adopted platform for monitoring AI applications. The…
A developer built a cost-attribution system for LLM usage by tagging every gateway span with `team.id`, `project.id`, and `feature.id` alongside OpenInference token-count attributes, shipping those sp…
At Microsoft Build, Microsoft Chief Product Officer for Responsible AI Sarah Bird announced the open trust stack for AI agents, centered on two new open-source projects: ASSERT for spec-driven evaluat…