Transformers converge to invariant algorithmic cores
Researchers introduced Algorithmic Core Extraction (ACE) to isolate compact subspaces, or algorithmic cores, that are necessary and sufficient for a task and recur across independently trained transfo…