Honeycomb published a complete, annotated OpenTelemetry Collector configuration for LLM observability that receives traces over OTLP, normalizes OpenInference and OpenLLMetry schemas onto GenAI semant…
Arize Phoenix contributor Ashwin Govind Ugale released tracelint, an open-source linter that runs deterministic structural checks on OpenInference traces and returns a CI-usable exit code, avoiding LL…
Arize AI is a launch partner for MongoDB's Atlas Agent Engine, a new platform for building, deploying, and governing AI agents in production, with Arize AX adding trace-level observability and evaluat…
SigNoz's AI Observability feature now lets Admins remap LLM, agent, and tool span attributes to OpenTelemetry GenAI semantic convention names through an Attribute Mapping tab, with default groups gen_…
Developer Ashwin Ugale released tracelint, an open-source linter that detects structural defects in AI agent execution traces without using an LLM. The tool reads telemetry from OpenInference, Arize P…
CrewAI launched Crew Studio, an Automated Agent Builder with native Arize AX tracing and evaluation integration, enabling teams to send traces from the first run without custom instrumentation. The in…
OpenTelemetry released the GenAI Normalizer, a processor for the OpenTelemetry Collector, that translates span attribute labels from LLM instrumentation frameworks such as OpenLLMetry and OpenInferenc…
Arize AX, the AI observability platform from Arize AI, now natively supports OpenTelemetry GenAI semantic conventions, enabling teams to send gen_ai.* telemetry directly over OTLP without custom proce…
Agent Detective, a new open-source evaluation framework for multi-agent systems, identifies the first node where quality breaks in a pipeline by ingesting standard OpenTelemetry traces and rebuilding …
Enprompta launched an evaluation and observability platform for AI teams that traces LLM calls, runs automated evals, and enables prompt iteration in production without redeploying. The platform offer…
A new command-line tool called token-trace-viewer lets developers trace token and dollar costs across sub-agents in a single multi-agent run by reading OpenInference-style JSONL trace files. The Pytho…
An agent skill reduced average latency by 56%, token usage by 27%, and estimated cost by 44%, but also decreased answer completeness. The regression was detected only after tracing both versions in Ar…
SigNoz's open-source LLM observability features (v0.133.0+) require two specific environment variables to be set simultaneously to bypass silent configuration hurdles that prevent dashboards from load…
SigNoz v0.133.0 was deployed via Foundry for AI agent observability, but a developer discovered that the OpenInference instrumentation used by openinference-instrumentation-agno does not follow the st…
SigNoz's LLM observability feature, shipped in v0.133.0, is nearly unreachable due to three silent configuration gates and a bug that prevents processors from being wired into pipelines. A hackathon t…
SigNoz announced support for monitoring DSPy programs via OpenTelemetry, enabling real-time visibility into DSPy module calls and language model requests. The integration uses the OpenInference DSPy i…
A developer built Otterscope, a lightweight observability tool for LLM agents that runs as a single Go binary with SQLite, avoiding the complexity of hosted or multi-service solutions. The tool ingest…
TrueFoundry announced a native integration between its AI Gateway and Arize, enabling enterprises to trace, evaluate, and monitor AI model calls across multiple providers and agent frameworks without …
HALO, an open-source tool for debugging and optimizing AI agents using execution traces, has been released. It uses a Recursive Language Model to analyze traces and find systemic issues, and can optio…
Arize AI released Project Rosetta Stone, a reference implementation that builds the same agent across 22+ frameworks with three observability tiers, enabling engineers to see exactly how to instrument…