# Human-on-the-Bridge proposes scalable evaluation for AI agents > Source: > Published: 2026-06-16 05:21:27.615620+00:00 # Human-on-the-Bridge proposes scalable evaluation for AI agents Per the arXiv paper submitted 15 June 2026, the paper "Human-on-the-Bridge" (HOB) introduces a scalable evaluation paradigm for agentic AI. The paper describes placing human expertise upstream to curate reusable evaluation artifacts, domain context, Red-Team Traps, Juror Personas, scoring guidelines, audit rules, and fallback policies, and then repeatedly executing them via a ProofAgent Harness. The study reports running **23,500 agent turns** and producing evidence-linked findings across **finance, healthcare, and code generation**, per the arXiv submission. The paper reports that HOB surfaces failures often missed by static benchmarks and single-evaluator scoring, including phantom tool-call claims, missing mandatory tool calls, policy drift, manipulation paths, and safe but non-resolving refusals. The authors report that smaller Harness LLMs can challenge agents built on frontier LLM backbones when the curated evaluation intelligence is reused across runs, according to the paper. ### What happened Per the arXiv paper submitted 15 June 2026, **Human-on-the-Bridge (HOB)** is a proposed evaluation paradigm for agentic AI that places curated human expertise upstream and reuses it across repeated tests. The paper describes a ProofAgent Harness that executes multi-turn adversarial evaluations, captures traces, applies multi-juror scoring, and produces evidence-linked reports. The study reports **23,500 agent turns** and coverage across **finance, healthcare, and code generation**, per the arXiv abstract. ### Technical details Per the paper, the upstream curation includes reusable artifacts: domain context, Red-Team Traps, Juror Personas, scoring guidelines, audit rules, and fallback policies. The Harness runs asymmetric and symmetric evaluations across agent and evaluator LLM tiers and captures trace-linked evidence to support scoring and audits, according to the submission. ### Industry context Encoding expert judgment as reusable evaluation artifacts addresses common scaling gaps between human-in-the-loop review and automated benchmarks. Comparable evaluation work often mixes static benchmarks with episodic red teaming; HOB formalizes reusable adversarial scenarios and multi-juror scoring to increase repeatability and traceability. ### Context and significance For practitioners, richer multi-turn, evidence-linked evaluation helps surface behavioral failures (tool-call hallucinations, policy drift, manipulation paths) that single-turn benchmarks miss. The reported ability for smaller evaluator LLMs to challenge stronger agents, if reproducible, could materially lower evaluation compute costs and broaden continuous testing. ### What to watch Follow the paper for a full methods appendix, code or harness release, and peer replication on diverse agent stacks to validate scalability and cross-domain reliability. ## Scoring Rationale Human-on-the-Bridge introduces a reusable, evidence-linked evaluation paradigm for agentic AI across 23,500 turns and three domains, addressing a real gap in repeatable agent evaluation. Solid methodology contribution, but remains a single arXiv preprint without code release or independent replication. Practice with real Ad Tech data 90 SQL & Python problems · 15 industry datasets [Active Search Campaigns by BudgetEasy](/problems/sql/active-search-campaigns-by-budget) [High CPC Clicks & Poor Landing PagesMedium](/problems/sql/high-cpc-clicks-poor-landing-page) [Campaign ROAS by Attribution ModelHard](/problems/sql/campaign-roas-by-attribution-model) 250 free problems · No credit card [See all Ad Tech problems](/problems/datasets/adtech)