# Disentangling Representation Evolution in Transformers through Directional Decomposition > Source: > Published: 2026-09-16 03:00:05+00:00 Transformer representations evolve through learned additive transformations that either preserve their current direction or redirect it. We study this evolution as a functional geometry, decomposing learned updates into parallel and perpendicular components. Across pretrained models, we find substan