Why Grokking Could Change How We View AI Training
Researchers propose a 'shell-core' theory to explain grokking, a delayed generalization phenomenon in neural networks, where solutions move from an outer shell to a core of generalization. The framewo…