04:00
2026-10-08
arxiv.org
large-language-models
LRCC: Generalizing Low-Rank Compression with Conditional Computation
Low-Rank Conditional Computation (LRCC), a method that trains one lightweight router per Transformer block to select among nested low-rank paths while keeping low-rank factors frozen, improved average…