{"slug": "veriphy-agentic-physical-reasoning-for-world-model-evaluation-and-refinement", "title": "VeriPhy: Agentic Physical Reasoning for World Model Evaluation and Refinement", "summary": "VeriPhy, an auditable physical-verification system that compiles prompts into typed physical obligations and uses frozen low-level experts to produce provenance-carrying evidence, accounts for 228 of 304 human-annotated flaw records on a 149-clip core, outperforming a published question-decomposition evaluator (164) and matching a monolithic backbone (222) while retaining full traceability. The system, introduced in arXiv paper 2609.03153v1, aims to evaluate and refine world models by localizing generation failures in prompt reference, space, and time.", "body_md": "arXiv:2609.03153v1 Announce Type: new\nAbstract: Visual fluency in generated video does not imply physical reliability, and a scalar quality score alone is incapable of indicating the obligation a clip violates or the moment it fails. We present VeriPhy, an auditable physical-verification system in which a text-only planner compiles the prompt into typed physical obligations and a statically validated execution plan before any frame is observed. During execution, observations gate and scope only declared calls to frozen low-level experts (e.g., segmentation and tracking, counting, eleven typed physical measurements over the resulting tracks, depth, OCR, and audio-event detection). Each action returns a provenance-carrying evidence record whose payload, when usable, is either a typed measurement or an explicitly tagged learned state. Typed resolvers and fixed composition map usable records to a three-valued state (supported, contradicted, or unknown, surfaced as plausible, implausible, or abstain) with full provenance, so that every verdict is traceable to the evidence that produced it. We anchor evaluation in a 1,500-clip corpus of human-annotated flaw records that localize real generation failures in prompt reference, space, and time. On a 149-clip core carrying 304 such records, VeriPhy accounts for 228, against 164 for a published question-decomposition evaluator given the same clips and the same claims. Recall alone does not separate it from prompting the same backbone monolithically, which reaches 222; what separates them is that each decision retains its evidence record and provenance, making the traces auditable one verdict at a time and usable as the interface through which a critic verdict could be written back into generation.", "url": "https://wpnews.pro/news/veriphy-agentic-physical-reasoning-for-world-model-evaluation-and-refinement", "canonical_source": "https://arxiv.org/abs/2609.03153", "published_at": "2026-09-04 04:00:00+00:00", "updated_at": "2026-09-04 04:24:30.095050+00:00", "lang": "en", "topics": ["artificial-intelligence", "ai-research", "ai-safety"], "entities": ["VeriPhy", "arXiv"], "alternates": {"html": "https://wpnews.pro/news/veriphy-agentic-physical-reasoning-for-world-model-evaluation-and-refinement", "markdown": "https://wpnews.pro/news/veriphy-agentic-physical-reasoning-for-world-model-evaluation-and-refinement.md", "text": "https://wpnews.pro/news/veriphy-agentic-physical-reasoning-for-world-model-evaluation-and-refinement.txt", "jsonld": "https://wpnews.pro/news/veriphy-agentic-physical-reasoning-for-world-model-evaluation-and-refinement.jsonld"}}