Amid mounting concern over AI's impact on cybersecurity following OpenAI's breach of HuggingFace, the lab's latest model is a step in ameliorating the issue.
On Thursday, the company announced GPT-6 Cyber, a model that it claims is "far more reliable" at staying within the boundaries that researchers set. OpenAI claims the model is better at finding and patching vulnerabilities, offering a significant improvement over its predecessor.
OpenAI said the model is already helping secure real-world software, including finding and validating exploits in "security-critical" codebases. For instance, in Linux, the model developed 948 privilege escalation exploits, or exploits in which someone gains higher levels of control than they are granted. Additionally, it identified 81 previously unknown "high-severity" vulnerabilities in Firefox, and is being used by teams at Cisco, Calif and CodeRabbit for vulnerability research and code review. OpenAI said the model is also being used to secure its own systems.
The company tested the model on ExploitGym, the benchmark for testing whether a model can exploit a specific software vulnerability that was also involved in July's HuggingFace breach.
- OpenAI said GPT-6 Cyber scores 48.5% on this evaluation, up from 32.1% on the previous generation, GPT-5.6 Cyber. It also outperforms GPT-6 Astra, OpenAI's most advanced model, in this benchmark, which scored 42.4%.
- It also noted that GPT-6 Cyber avoided exploiting "out-of-scope services" in 99.93% of tests without a deployment prompt, or additional safety instructions that keep a model in bounds, and in 100% of tests with a deployment prompt.
- OpenAI noted that alignment was a "central focus" of GPT-6 Cyber, utilizing specialized training to help the model stay within specified boundaries.
- However, the company is also adding additional protections, including monitoring for misalignment and emerging threats, protecting against stolen credentials and blocking high-risk activity involving critical systems.
The company said it is releasing the model through the API and Codex to select members of Project Daybreak Red, its program designed for more advanced cybersecurity workflows, and that it intends to expand access over time.
"Our goal is to dramatically expand Daybreak, bringing advanced security research to organizations of every size, independent researchers, and open-source maintainers," the company said in its announcement.
Our Deeper View #
It's clear that OpenAI wants to atone for the HuggingFace incident in July, with this model specifically improving on staying within containment, even going so far as to test using the same benchmarks that were involved in the incident in the first place. And based on its performance, GPT-6 Cyber does represent a step in the right direction. However, the discussion around model containment and cybersecurity goes hand-in-hand with another hot topic: pacing the development of increasingly powerful frontier AI. The reality is that, in order to stop incidents like these from happening, the development of powerful AI needs to be reined in to allow for cybersecurity defenses to catch up, something that AI researchers and experts have been warning about for months. Though OpenAI has said more than once that the window to secure software is rapidly closing, when frontier labs release new models, they are effectively making that window even smaller. While GPT-6 Cyber could immediately give defenders the ammo they need, these kinds of tools may need to be paired with efforts to slow the pace of development.