Nvidia's market share in AI inference chips rose to 74% from 66%, driven by its Blackwell architecture offering up to 35x lower token costs, cementing its dominance in the fastest-growing AI sector as…
NVIDIA Research released cuTile Rust, a tile-based system for writing memory-safe, data-race-free GPU kernels in Rust. The project extends Rust's ownership model to GPU programming, achieving up to 92…
Flama 2.0 introduces first-class support for generative AI, enabling users to download, package, and serve large language models (LLMs) via a single command line. The framework allows fetching models …
Lemonade SDK has added support for Nvidia CUDA acceleration, enabling GPU-accelerated computing for developers using the SDK. The update targets developers working with languages such as C#, Ruby, Pyt…
A researcher using nanoGPT on a MacBook Pro faces dependency failures when moving to a GPU cluster, prompting a solution using Nix and Flox to create reproducible, cross-platform runtime environments …
A developer released FlashQwen, a from-scratch CUDA inference engine for Qwen3-8B, built with C++ and CUDA. The project is hosted on GitHub and aims to provide efficient inference for the Qwen3 langua…
NVIDIA researchers developed an agentic system for deploying machine learning models to ephemeral SageMaker endpoints, generating runtime code at deployment time from prose artifacts rather than reusa…
JAX's default_device context manager places arrays on the specified device but does not commit them, allowing JAX to move them to other devices. This caused array lookups to take over a second by trig…
Polar Signals has released an open-source, low-overhead continuous profiler for NVIDIA CUDA that supports Program Counter (PC) sampling, allowing developers to see where GPU code spends time at the in…
A new pre-generation knowledge-boundary estimator with CUDA support has been developed. The tool uses a small sidecar model and prompt-only features to predict whether a language model will answer cor…
Researchers propose Gefen, a memory-efficient optimizer that reduces AdamW's memory footprint by ~8x while maintaining performance, enabling larger microbatches and improved throughput in deep learnin…
LLMKube has introduced a new cluster-scoped CRD, AgentRelease, and a self-update path to make fleets of self-hosted LLM agents trustworthy. The system allows safe, automated updates with atomic symlin…
A user combined an RTX 5080 and RTX 3090 on an Asus Prime X570-Pro motherboard to run Qwen 3.6 27B Q8 at over 80 tokens per second. The setup required disabling CSM, enabling Above 4G Decoding and ReS…
Nvidia CEO Jensen Huang announced a paradigm shift in computing from data retrieval to real-time generation, driven by AI factories and purpose-built CPUs. The company's Vera CPU for agentic AI has al…
NVIDIA's Blackwell Ultra NVL72 platform achieved top performance on the first agentic AI benchmark, AgentPerf from Artificial Analysis, running up to 20 times more agents per megawatt than the previou…
Telnyx has added MiniMax's M3 model to its Inference platform, offering the first open-weight model combining coding, agent capabilities, and a 1M-token context window. Hosted on Telnyx's B300 GPU inf…
NVIDIA's cuDF library now provides GPU-accelerated execution engines for the Polars Lazy API, enabling users to run dataframe operations on GPUs with automatic fallback to CPU when operations are unsu…
AMD released Lemonade SDK version 10.7, adding NVIDIA CUDA support to its local AI server solution that previously only supported AMD hardware, Apple Metal GPUs, and AArch64 CPUs. The update integrate…
A buyer who spent roughly $10,000 on both a Mac Studio M3 Ultra with 512 GB of unified memory and a dual NVIDIA DGX Spark setup ran the same 397-billion-parameter model on each machine and measured th…
Chris Lattner, a lead engineer on Apple's original OpenCL implementation, explains why OpenCL and other C++-based GPU programming models failed to become dominant in AI, citing slow committee-driven d…