SDAR

A developer evaluating the SDAR paper's claims found that the reported +9.4% accuracy gain on ALFWorld is less interesting than SDAR's ability to avoid training instability. The developer designed a t…

A developer implemented the SDAR gate, a gated distillation mechanism for reinforcement learning with language models, in PyTorch. The gate uses a sigmoid function to weight a per-token KL divergence …