Researchers at Northwestern University tested AI coding agents on 112 real security bugs. They found that a patch which stops a crash often fails the checks the project’s maintainers wrote for the fix. With Claude Opus 4.7, third of the patches that made the crash go away still failed those maintainer tests. If you’re thinking about letting an AI tool patch vulnerabilities for you, this is the number to look at. Many security patching benchmarks … More
The post AI vulnerability patching has a grading problem appeared first on Help Net Security.
source & further reading
helpnetsecurity.com — original article
High-severity NVIDIA vulnerability lets unauthenticated attackers crash GPU monitoring
PCI SSC calls for human approval of AI agent actions involving cardholder data
Companies want autonomous IT operations but hesitate to let AI act alone