# The Error Message Didn't Matter | barkup-bench Study AJ

> Source: <https://www.lightningjar.com/blog/the-error-message-didnt-matter>
> Published: 2026-07-17 14:53:43.969912+00:00

For thirty-five studies, one mechanism rode along in every arm of our benchmark without ever being tested: when a model's patch fails validation, we return the structured issues verbatim for a correction round. It felt obviously load-bearing. Study AJ finally isolated it, by seeding known failures and varying only the feedback text: the full structured issues, bare issue codes, or nothing but 'the anchored patch was invalid.' The result is parity on all three models. Opus recovered 45 of 45 in every arm, including from the bare sentence. Gemini scored an identical 42 of 45 in every arm, missing the same three cells each time no matter what we told it. Told a patch failed, models simply re-derive the correct edit from the task and the tree. The verbatim-issues commitment survives with its rationale corrected: it is developer UX, not model recovery. The error message was for us.