Discord safety system falsely banned accounts for grid images, unban in progress

Discord's safety systems falsely banned approximately 200 accounts over the weekend for posting square grid images, including spreadsheets and chessboards, which were incorrectly flagged as CSAM. The company has reinstated all affected accounts and is working to fix the vulnerability in its AI moderation.

This weekend, our safety systems incorrectly triggered and banned around 200 accounts. Everyone affected has been reinstated. Here's what happened. A thread 🧵 There’s currently a vulnerability in Discord’s AI moderation that detects any and all square grid images, such as spreadsheets, chessboards, Minecraft inventories, white & gray transparent backgrounds… as CSAM and will permanently ban your account. To keep your account safe, I