# Learning Functional Subspaces for Neural Network Compression > Source: > Published: 2026-10-07 16:00:00+00:00 Modern transformers pair impressive capabilities with substantial memory and compute demands. Low-rank weight factorization reduces both while keeping the matrices dense, and thus efficient on standard hardware. Existing methods, however, choose the subspace to remove from each weight matrix with lo