18:10
2026-07-07
lesswrong.com
ai-safety
Probing is not enough; a validity audit for any probe
A researcher audited three probes—a monitoring awareness probe, a refusal direction, and Apollo's deception probe—and found that a probe achieving perfect AUROC can still fail as a safety signal by tr…