23:31
2026-07-06
pytorch.org
large-language-models
Bringing PyTorch Monarch to AMD GPUs: Single-Controller Distributed Training on ROCm
AMD has brought PyTorch Monarch to its Instinct GPUs with ROCm, enabling single-controller distributed training for large language models. The port addresses reliability challenges at scale by providi…