Forward Pass Domain Adaptation (Without Cross-Layer Backpropagation)
A new method called Forward-Pass-Only MLP training (FPO) adapts large language models without a backward pass, achieving 2.7–3.2x the throughput of standard fine-tuning at ~40% less peak training memory, while keeping of…