PyTorch Monarch

A joint AMD–Meta team ported Meta's PyTorch Monarch distributed-training runtime to AMD's ROCm platform, running it on clusters of 128 MI300 and 256 MI355 GPUs with all 1,171 tests passing on ROCm 7.0…

AMD has brought PyTorch Monarch to its Instinct GPUs with ROCm, enabling single-controller distributed training for large language models. The port addresses reliability challenges at scale by providi…