AI agent teams must build robust evaluation systems to prevent reward hacking and ensure agents complete tasks as intended, according to experts at Arize Observe 2026. Agent evals, which score outputs…
Model subsidies are ending as flat-rate AI subscriptions prove unsustainable for agentic workloads, which consume up to 1,000 times more tokens than standard queries. Artificial Analysis' AA-Briefcase…
Hamel Husain argued at Arize Observe 2026 that AI evaluation is fundamentally a data science problem, urging teams to return to rigorous data analysis and metric design rather than relying on vague 'v…
TrueFoundry announced a native integration between its AI Gateway and Arize, enabling enterprises to trace, evaluate, and monitor AI model calls across multiple providers and agent frameworks without …
A new wave of long-horizon agent benchmarks, including Agents' Last Exam, SWE-Marathon, the Meta-Agent Challenge, and Arena's Agent Mode, reveals a fundamental trade-off between realism and verifiabil…
Arize AI released Project Rosetta Stone, a reference implementation that builds the same agent across 22+ frameworks with three observability tiers, enabling engineers to see exactly how to instrument…
Uber's COO Andrew Macdonald revealed the company exhausted its 2026 AI coding budget in four months, unable to link rising Claude Code token usage to shipped features. The disconnect between token con…
Arize AI launched PXI (Phoenix Intelligence), an open-source AI engineering agent integrated into its Phoenix observability platform, at the Arize:Observe conference. PXI helps developers debug traces…
The AI agent development stack is shifting from frameworks to harnesses—control loops that wrap models and manage task decomposition, retries, and context. Leaders from LlamaIndex, LangChain, Anthropi…
On May 6, 2026, Anthropic launched Dreams for its Managed Agents platform, followed by OpenAI's Dreaming V3 for ChatGPT on June 2, 2026. Both features use background processes to consolidate memory fr…
Agent orchestration spans three distinct layers—expression, runtime, and observability—that are often conflated in debates about multi-agent systems. A June 2025 clash between Cognition's 'Don't Build…
Arize AI and Databricks announced a dual-export capability for OpenTelemetry traces, allowing teams to send the same production traces to both Arize AX for operational debugging and Databricks Unity C…
The tech industry shipped four types of memory systems this week, none of which match what users understand the term to mean. Apple paid Google an estimated $1 billion annually for a system-wide seman…
Arize Data Fabric now supports Databricks, enabling teams to sync production agent traces, evaluations, and annotations into customer-owned cloud storage and register them in Unity Catalog. This integ…
An experiment comparing PostgresFS, a Postgres-backed filesystem abstraction, against a SQL skill for AI agents found that the SQL skill achieved higher overall accuracy and lower maintenance costs. T…
Arize AI cut its median support resolution time from 22 hours in February to roughly 2.5 hours by building AI-native internal workflows that automate context gathering for complex technical issues. Th…
In May 2026, two supply-chain attacks targeted AI coding tools including Claude Code and Cursor, with one malicious VS Code extension stealing npm, AWS, GitHub, and SSH credentials from 6,000 develope…
Phoenix, an open-source AI observability project, crossed 10,000 GitHub stars after growing from a Jupyter notebook extension in 2023 into a widely adopted platform for monitoring AI applications. The…
At Observe 2026, Arize AI launched new Arize AX capabilities designed to automate the agent improvement loop for production systems, including Signal for continuous failure detection, agent orchestrat…
At Microsoft Build, Microsoft Chief Product Officer for Responsible AI Sarah Bird announced the open trust stack for AI agents, centered on two new open-source projects: ASSERT for spec-driven evaluat…