Higgsfield AI, a generative AI company with $500M in annual revenue run rate and 25M+ users, is hiring an ML Systems Performance Engineer (MFU) for its Almaty, Kazakhstan office. The role focuses on o…
Z.ai and NVIDIA engineers trained GLM-5.2, a 744B-parameter mixture-of-experts model quantized to 4-bit NVFP4, with reinforcement learning to play Super Mario Bros., overcoming arithmetic, distributed…
AI applications run in data centers, and their performance depends on a five-layer stack of software, hardware, and infrastructure, not just the model. The article explains that training and inference…
Researchers at NVIDIA have enhanced preconditioned gradient methods like SOAP and Muon to overcome computational cost and numerical stability challenges in large-scale LLM pretraining, demonstrating t…
NVIDIA released Audex (Nemotron-Labs-Audex-30B-A3B), a unified audio-text large language model that processes both audio and speech while preserving the text intelligence of its backbone. The model us…
NVIDIA released NeMo AutoModel, a library that integrates Expert Parallelism and DeepEP into Hugging Face's API, achieving 3.4x to 3.7x higher training throughput and 29% to 32% lower GPU memory consu…
Frontier LLMs including GPT-5.5, Gemini 3 Pro, and Opus 4.7 failed to correctly solve over two-thirds of problems in ParallelKernelBench, a new benchmark for multi-GPU kernel generation. The benchmark…
AWS released a comprehensive guide for distributed AI training on its infrastructure, featuring reference architectures, test cases, and best practices for frameworks like PyTorch, Megatron-LM, NeMo, …
Baidu Baige has released LoongForge, an open-source training framework for large language models, vision-language models, diffusion transformers, and vision-language-action models, claiming up to 5.04…