People use AI chatbots for company, advice, and emotional support, and these systems answer in ways meant to hold their attention. Researchers describe the resulting risks as affective safety, a class of harm that exists because humans are emotional beings and because the systems engage directly with that emotional life. The damage happens during ordinary use, with no breach and no intruder. These systems work as designed, optimizing for the goals their builders set, and … More
The post Sycophantic chatbots and the harms that build over many chats appeared first on Help Net Security.
source & further reading
helpnetsecurity.com — original article
Companies keep bolting AI onto their products, and the security bill is coming due
Most teams accept higher risk for faster AI database work
Week in review: Fortibleed campaign’s impact on orgs, Cisco Unified CM flaw exploited