State commitment learning: training language models to distinguish computation from memory
Researchers have introduced state commitment learning, a new training objective that teaches language models to distinguish temporary computation from persistent memory. The method, called Counterfactual Erasure RL (CERL…