# MUON-RT Reusing the Teacher's Trajectory for Momentum-Free Muon for LLM Self-Distillation > Source: > Published: 2026-11-05 06:00:00+00:00 Self-distillation methods for large language models with an exponential moving average (EMA) teacher already retain a history of student updates. Muon nevertheless stores a separate momentum buffer, increasing persistent training memory. We propose Muon with Reused Teacher (Muon-RT), which reuses th