Ianbarber (auto-discovered)

Nvidia's Hopper and Blackwell GPU architectures introduced spatial scheduling through warp specialization, requiring developers to divide pipeline work between different warp groups for data movement …

Meta's FAIR team documented a series of training failures in 2021 for their OPT-175B model, including repeated loss explosions and learning issues that required extensive hyperparameter tuning and arc…