{"slug": "google-open-sources-ambient-quality-agent-aqua-to-diagnose-production-ai-agent", "title": "Google Open Sources Ambient Quality Agent (AQuA) to Diagnose Production AI Agent Failures", "summary": "Google open-sourced AQuA (Ambient Quality Agent), a reference implementation that samples up to 1,000 recent production agent sessions per run and diagnoses silent quality failures against an immutable source snapshot captured at deployment. In a controlled replay of 32 sessions from a multi-agent travel application, AQuA surfaced 42 findings that clustered into nine candidates; its verifier rejected three unsupported clusters, and after developers modified prompts, seat-selection bypasses fell from 15 sessions to two, dietary-preference omissions dropped from seven to zero, and sessions passing all checks rose from five to 13. AQuA runs outside the agent's request path on Google Cloud, reading telemetry from Cloud Trace, Cloud Logging or BigQuery, and proposes fixes with file and line citations but does not apply them or open pull requests automatically.", "body_md": "Google has [open-sourced AQuA (Ambient Quality Agent),](https://developers.googleblog.com/the-outer-loop-insights-first-an-ambient-quality-agent-that-diagnoses-your-production-agent/) a reference implementation that analyzes production AI agent sessions, verifies recurring failure patterns, and investigates root causes against deployed source revisions. The tool targets silent quality regressions that conventional infrastructure monitoring can miss, such as agents ignoring user preferences or skipping required tool calls while returning successful responses.\n\nAQuA runs alongside an agent in Google Cloud, outside its request path, reading telemetry from Cloud Trace, Cloud Logging, or BigQuery. It samples up to 1,000 recent sessions per run and processes them through five stages: sampling, reviewing, clustering findings, verifying candidate clusters, and tracking issues. Developers can configure domain-specific quality criteria through a `goal.md` file and add deterministic custom metrics. AQuA can run on a schedule, after a deployment, or on demand.\n\nFor root cause analysis, AQuA compares failing sessions with an immutable source snapshot captured at deployment. Its diagnosis agent identifies relevant code or instructions, cites file and line ranges, and proposes changes when the cause lies in the repository. It can also attribute failures to external dependencies, tool handoffs, or retrieved data. AQuA does not apply fixes or open pull requests automatically.\n\n*AQuA sidecar architecture (Source: [Google Developer Blog Post](https://developers.googleblog.com/the-outer-loop-insights-first-an-ambient-quality-agent-that-diagnoses-your-production-agent/))*\n\nGoogle evaluated 32 sessions from a multi-agent travel application, identifying 42 findings grouped into nine candidate clusters. The verifier rejected three unsupported clusters after checking up to three full transcripts per candidate cluster, leaving six verified issues. Two involved bypassing seat availability checks and losing a traveler's vegan preference during delegation.\n\nAfter developers modified prompts and replayed the sessions, seat-selection bypasses fell from 15 sessions to two, dietary-preference omissions dropped from seven to zero, and sessions passing all checks increased from five to 13. These results came from controlled replay, not production traffic.\n\nThe Google blog post states,\n\nAn insight is its citations, not a self-reported confidence score.\n\nFindings link to supporting traces, and proposed root causes must reference valid lines in the deployed snapshot. AQuA tracks findings as `NEW`, `RECURRING`, or automatically `RESOLVED` after 14 days without being observed. Sampling can miss rare failures, and replay may not reproduce external state.\n\nReacting to the announcement on [LinkedIn](https://lnkd.in/p/gEKfSeK9), [Dmytro Aprelenko](https://www.linkedin.com/in/dmytroaprelenko/), engineering manager at Redcore, [wrote](https://lnkd.in/p/gsFr4Hyg),\n\nAgent orchestration definitely needs better continuous diagnosis to catch these loops early.\n\nAQuA validates source references and links findings to supporting traces. Cluster verification filters false positives, though it cannot confirm every session exhibits the same failure. Google's [Agent Platform evaluation service](https://docs.cloud.google.com/gemini-enterprise-agent-platform/optimize/evaluation/evaluate-agents?utm_source=chatgpt.com) supports regression testing and production quality monitoring, while [Arize Phoenix](https://arize.com/phoenix/?utm_source=chatgpt.com) provides open-source tracing and evaluation. AQuA focuses on grouping production failures and linking verified findings to deployed source code.\n\nGoogle identifies sampling limits and incomplete reproduction of external state as constraints. Its [open-source implementation](https://github.com/google/adk-recipes/tree/main/core/python/ambient-quality-agent?utm_source=chatgpt.com) helps teams integrate production agent diagnosis into development and evaluation workflows.", "url": "https://wpnews.pro/news/google-open-sources-ambient-quality-agent-aqua-to-diagnose-production-ai-agent", "canonical_source": "https://www.infoq.com/news/2026/11/google-ambient-agent-prod/?utm_campaign=infoq_content&utm_source=infoq&utm_medium=feed&utm_term=global", "published_at": "2026-11-13 13:53:00+00:00", "updated_at": "2026-11-13 14:19:40.278317+00:00", "lang": "en", "topics": ["ai-agents", "ai-tools", "mlops", "artificial-intelligence"], "entities": ["Google", "AQuA", "Google Cloud", "Cloud Trace", "Cloud Logging", "BigQuery", "Dmytro Aprelenko", "Redcore"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/google-open-sources-ambient-quality-agent-aqua-to-diagnose-production-ai-agent", "markdown": "https://wpnews.pro/news/google-open-sources-ambient-quality-agent-aqua-to-diagnose-production-ai-agent.md", "text": "https://wpnews.pro/news/google-open-sources-ambient-quality-agent-aqua-to-diagnose-production-ai-agent.txt", "jsonld": "https://wpnews.pro/news/google-open-sources-ambient-quality-agent-aqua-to-diagnose-production-ai-agent.jsonld"}}