Sycophantic chatbots and the harms that build over many chats

Researchers warn that AI chatbots designed to hold users' attention pose affective safety risks by engaging with human emotions during ordinary use, causing harm without any security breach. The systems operate as intended but can damage users over many interactions.

People use AI chatbots for company, advice, and emotional support, and these systems answer in ways meant to hold their attention. Researchers describe the resulting risks as affective safety, a class of harm that exists because humans are emotional beings and because the systems engage directly with that emotional life. The damage happens during ordinary use, with no breach and no intruder. These systems work as designed, optimizing for the goals their builders set, and … More https://www.helpnetsecurity.com/2026/06/29/sycophantic-chatbots-affective-ai-safety/ The post Sycophantic chatbots and the harms that build over many chats https://www.helpnetsecurity.com/2026/06/29/sycophantic-chatbots-affective-ai-safety/ appeared first on Help Net Security https://www.helpnetsecurity.com .