04:41
2026-07-07
lesswrong.com
large-language-models
Data filtering works a lot worse than you would expect
Researchers at MATS found that filtering training data to remove undesired behaviors from large language models is largely ineffective, with removing the top 'proponent' documents performing no better…