The Scaling of PEFT: Towards Million Personal Models of Trillion Parameters
Researchers propose scaling parameter-efficient fine-tuning (PEFT) to support millions of personalized models on top of shared trillion-parameter foundation models. The study introduces three scaling axes—Scale Up, Scale…