Encoding and Propagation of Grammatical Number in Large Language Models
Researchers used sparse autoencoders trained on Pythia-70M to identify "plural noun," "plural matrix subject," and "generate a plural verb" features that drive the 70M-parameter model to emit plural verb forms such as "a…