CvAdamW

Researchers introduced CvAdamW, a variant of the AdamW optimizer that monitors attention logit variance as specific heat to detect and accelerate grokking in neural networks, enabling generalization a…