FSDP2

A user is asking how to replicate Hugging Face SFTTrainer's auto_find_batch_size=True behavior, which automatically reduces batch size after a CUDA out-of-memory error, when training across multiple G…

LinkedIn published details of a multi-teacher distillation pipeline that trains a 0.6B-parameter job-search ranking model roughly 8x faster, using a custom SGLang-based framework that serves teacher m…

Researchers have developed a memory-efficient training stack for Mixture-of-Experts models that achieves 4.7x to 8.2x higher per-GPU throughput compared to a finely-tuned FSDP2 baseline, using fewer t…