At-Grok Is Not Converged:A Measurement-Validity Audit for Grokking Representation Metrics
A new audit of grokking representation metrics reveals that effective rank measurements at the grokking transition overstate converged values by 3-5x on MLPs and 1.3-1.5x on transformers, with compression lagging accurac…