A Mesoscopic View of Transformer Weights Through Row and Column Scale Fields
A new arXiv paper (2609.35852v1) analyzes Transformer weights at a mesoscopic level using row and column scale fields — median-centred log-RMS profiles over a matrix's channels — which, with a global scale and a full bal…