NVIDIA released Audex (Nemotron-Labs-Audex-30B-A3B), a unified audio-text large language model that processes both audio and speech while preserving the text intelligence of its backbone. The model us…
NVIDIA released NeMo AutoModel, a library that integrates Expert Parallelism and DeepEP into Hugging Face's API, achieving 3.4x to 3.7x higher training throughput and 29% to 32% lower GPU memory consu…
Frontier LLMs including GPT-5.5, Gemini 3 Pro, and Opus 4.7 failed to correctly solve over two-thirds of problems in ParallelKernelBench, a new benchmark for multi-GPU kernel generation. The benchmark…
AWS released a comprehensive guide for distributed AI training on its infrastructure, featuring reference architectures, test cases, and best practices for frameworks like PyTorch, Megatron-LM, NeMo, …
Baidu Baige has released LoongForge, an open-source training framework for large language models, vision-language models, diffusion transformers, and vision-language-action models, claiming up to 5.04…