04:00
2026-06-15
arxiv.org
machine-learning
Gefen: Optimized Stochastic Optimizer
Researchers propose Gefen, a memory-efficient optimizer that reduces AdamW's memory footprint by ~8x while maintaining performance, enabling larger microbatches and improved throughput in deep learnin…