20:35
2026-09-25
dev.to
ai-research
I put one wrong test in the file. Most models sided with the test.
A developer built a Kaggle benchmark that gives models a function spec and a pytest file containing exactly one test that contradicts the spec, then scores which signal the model follows using hidden …