01:42
2026-09-22
discuss.huggingface.co
machine-learning
The LR Death Spiral 🧨 — Muon/Dion3 Debugging Saga
An engineer preparing optimizer experiments for an upcoming PyTorch Conference talk found that the Dion3 implementation in OLMo-core broke training with a learning rate death spiral while testing Adam…