AI Researchers Got Chatbots to Share Cocaine Recipes Using This One Wild Trick
Researchers tricked frontier AI models into generating cocaine synthesis instructions and leaking credentials using a new prompt injection attack called Chain-of-Thought Forgery. The attack exploits role confusion, where…