PlayStation 5 firmware: PS5 firmware security analysis using Codex and ChatGPT

Security researcher Devon used OpenAI's Codex and ChatGPT to analyze FreeBSD 11.0.0 kernel and WebKit source code in a PlayStation 5 firmware security study, answering over 130 questions with source citations, according to an open-source GitHub project. Devon reported that OpenAI's Daybreak content filter repeatedly triggered on prompts containing structural terminology and that the account was subsequently deactivated, though Devon maintains the work was strictly academic and involved no proprietary system access or exploit creation. Other researchers noted that LLM passes over JavaScriptCore can identify missing checks but the false positive rate for lifetime bugs remains high.

Evidence at a glance Loading source evidence… What was done Researcher Devon utilized Codex and ChatGPT to analyze FreeBSD and WebKit source code for PS5 security research, resulting in account deactivation due to alleged content filter triggers. The author, Devon, conducted academic source-code analysis on the FreeBSD 11.0.0 kernel and the WebKit browser engine to investigate the security architecture of PlayStation 5 firmware. The research, documented in an open-source project on GitHub https://x.com/Devon8zzh/status/2114429228959846677 , involved using Codex and ChatGPT to trace function call chains, data structure layouts, and allocation patterns. The author reports that over 130 questions were answered by the model with source citations. The author notes that OpenAI's Daybreak content filter repeatedly triggered on prompts involving structural terminology, which the author suggests may have contributed to the subsequent deactivation of their account. The author maintains that the work was strictly academic and did not involve accessing proprietary systems or creating exploits. Other researchers have noted that while LLM passes over JavaScriptCore JSC can identify missing checks, the false positive rate for lifetime bugs remains high.