04:00
2026-08-17
machinebrief.com
machine-learning
Approximate Muon with low-rank adapters
Researchers propose sMuon, a method that adapts the Muon optimizer for low-rank fine-tuning by approximating the orthogonalization step via linearization and least-squares, using only matmul operationβ¦