1Password research finds AI models fail to properly patch vulnerabilities 74% of the time

1Password's Off-By-1-Labs security research team found that frontier AI models fail to properly patch software vulnerabilities 74% of the time, producing incomplete or incorrect fixes for complex flaws. The findings contradict the hypothesized 67% success rate and assumptions that models trained on open source code would reliably generate working patches.

1Password research finds AI models fail to properly patch vulnerabilities 74% of the time According to 1Password's Off-By-1-Labs security research team, frontier AI models tasked with generating software patches achieve success rates significantly lower than the hypothesized 67%, with LLMs producing incomplete or incorrect fixes for complex vulnerabilities at high rates. The research contradicts assumptions that models trained on open source code and public disclosures would reliably generate working patches. Topics Sources - Press Read article https://www.zdnet.com/article/ai-isnt-ready-to-patch-your-software-74-of-them-miss-the-mark/ Go deeper This intelligence is sourced automatically from public sources across the web and synthesised by the Prefactor AI pipeline. Stories are reviewed before publication.