Hi all,
I’m a graduate student at the University at Buffalo, submitting to arXiv for the first time. I’m looking for an endorsement in cs.LG.
Paper: C2: A Spectrum-Preserving Counterfactual Control for LLM Weight-Reader Evaluations
Recent work reports that LLMs can read raw neural-network weights. A reader can succeed by recognising surface statistics rather than following the computation, and function-preserving controls such as neuron permutations can’t tell these apart. C2 permutes the columns of a network’s final layer, which changes its function but keeps that layer’s singular values, norm and entry multiset fixed. The note gives exact transforms, a frozen prompt manifest, tool-locked readers, a no-weights baseline and free behavioural baselines.
The results are modest and reported as such. In an exploratory 24-network pilot, one frontier reader route followed the rewired function on every input. That doesn’t separate fingerprints from mental execution, because the networks are small enough to compute by hand. Offline checks on public model zoos found no setting where weight statistics predict accuracy. An open-weight model given no reasoning scored no better than guessing.
Thanks for reading.
Vaishak Girish Kumar