A developer released two open-source Python tools aimed at simplifying local LLM inference on AMD GPUs. ROCmFix automatically resolves HSA_OVERRIDE_GFX_VERSION issues by querying PCI IDs via the Windo…
A developer released gemmcheck3, a self-checking rocBLAS GEMM stress test for AMD GPUs targeting RDNA3/gfx11 hardware such as the RX 7900 XTX. The tool runs five rocblas_gemm_ex calls in LLM layer sha…
Muon Space posted an on-site software engineer role in San Jose, CA for computer vision and machine learning at a salary range of $212,000 to $233,000 per year, plus equity and benefits. The listing, …
PicoLM v1.0-rc1, an LLM inference engine written in C99, has been released, supporting llama-2, GPT-2, Qwen 3.6/3.8(+MoE), and Gemma-3n models. The engine features CPU SIMD acceleration, CUDA/HIP supp…
AMD released ROCm 10.0, the first major version bump since the 7.x series, built entirely on TheRock automated build system and introducing ROCm.AI, a native agentic AI developer experience. The relea…
PantheonGPU 1.0.14, a GPU health testing and AI workload benchmarking tool, is now available as a Debian package and portable bundle for Linux. The tool tests GPU compute, memory, cache, interconnect,…
A research paper, “GPU Offload in Rust: Portable, Safe, and Fast” (arXiv:2608.13759), introduces GPU programming support directly into rustc, allowing developers to write GPU kernels in safe Rust with…
Modular shipped Mojo 1.0 on August 12 as part of its 26.5 release, marking the first production-ready version of its Python-syntax AI hardware language, with changes including uniform `var` syntax, a …
A developer's third installment in a GPU optimization series details implementing distributed training for large language models using CUDA and ROCm, covering All-Reduce, Ring-AllReduce, and ZeRO shar…
AI coding agents are eroding Nvidia's CUDA software moat by lowering the expertise barrier for GPU kernel development, according to a tech analysis. Tools like Anthropic's Claude Code can generate per…
AMD ROCm software provides an open-source stack for programming AMD GPUs, enabling high-performance video inference pipelines. A tutorial demonstrates building a pipeline using rocDecode for hardware-…
Researchers present Fleet, a hierarchical task-based abstraction for multi-die GPUs that introduces Chiplet-tasks to exploit chiplet-level locality and synchronization. On AMD Instinct MI350 with Qwen…
AMD published a blog post detailing a workflow that combined ROCm profiling tools with Cursor's AI code-assist agent to optimize a double-precision HIP kernel on an Instinct MI250 GPU, achieving a cum…
CUDA remains the dominant language for GPU compute in AI and HPC, but teams facing NVIDIA card scarcity or multi-vendor fleets have three main options: drop-in layers like ZLUDA for binary compatibili…
AMD launched the Ryzen AI Halo workstation at nearly $4,000, offering 128 GB of unified memory for local AI model training and inference. The system is cheaper than Nvidia's DGX Spark but uses year-ol…
Navatala Systems released Navatala GPU, an open-source cross-platform GPU compute runtime and kernel corpus supporting CUDA, HIP, Vulkan, OpenCL, and Metal backends. The alpha release includes Python …
A team of kernel engineers developed a bf16 forward attention kernel for AMD MI300X GPUs using HIP, outperforming AMD's own AITER v3 library by up to 1.26× across various token lengths and rounding mo…