Researchers present Verify the Verifier, an LLM-based checker that compares traces from passing UVM regressions with specifications. Of 564 bugs inserted into four OpenTitan IPs, 68 were candidate scoreboard escapes, and the framework confirmed 41.
Passing tests can hide specification violations; cross-checking traces against specifications could catch costly hardware bugs earlier.
What happened: an LLM anomaly cross-checker examined passing regression traces against specifications and confirmed 41 of 68 candidate escapes across four OpenTitan IPs. Why it matters: it targets bugs invisible to conventional scoreboards. Main uncertainty: false-positive rate, human review cost, and generalisation beyond inserted bugs and these IPs are not stated.
Source: arXiv AI disclosure: this article was produced with AI assistance and reviewed for accuracy.