Mark Pesce of the University of Sydney introduces Verification Design, a discipline that applies double-entry bookkeeping principles to AI agents by using formal verification to catch and exclude erro…
A July 2026 paper series by Mark Pesce of the University of Sydney introduces a verification record for AI-generated academic work, documenting 75 findings from adversarial reviews across four papers.…
Autonomous AI agents working in iterative loops can improve any artifact against any standard they can be scored on, but most measures can be gamed, according to Mark Pesce of the University of Sydney…
Mark Pesce of the University of Sydney argues that the growing intractability of AI evaluations is itself proof that artificial general intelligence (AGI) has arrived. He contends that AI evals fail f…
AI evaluations are failing as models approach general intelligence, with benchmarks saturating through contamination and Goodhart effects while the scope of evaluation expands from minutes to months. …
Software engineers at a recent conference expressed fear and grief over the spread of agentic AI systems, and discussed practical responses including token-cost management and cheaper diffusion models…