The newest AI security threat: token torching

Researchers have identified a new AI security vulnerability called 'token torching,' where attackers manipulate token generation in large language models to bypass safety measures or cause erratic behavior. The threat exploits how models process tokens, potentially enabling unauthorized actions or data leaks. Experts warn that as LLMs become more integrated into applications, such attacks could have serious consequences for AI safety.