GMKtec unveiled the redesigned EVO-X3 AI mini PC workstation, powered by AMD's Ryzen AI Max+ 395 processor with 128 GB of unified memory and an OCuLink port for eGPU expansion. The device, priced at $…
OpenCode, an open-source terminal-first coding agent, now supports self-hosted large language models via OpenAI-compatible APIs, enabling users to connect it to a vLLM server running NVIDIA's Nemotron…
Alibaba's Qwen3-80B and Qwen3-4B models were successfully co-located on a single NVIDIA DGX Spark using vLLM containers behind a LiteLLM proxy, but the 80B model's inability to emit tool calls in auto…
Local LLM inference splits into two phases—prompt processing (compute-bound) and generation (memory-bandwidth-bound)—explaining why hardware with identical token generation speeds can have vastly diff…
Nvidia announced the RTX Spark platform at Computex 2026, combining an Arm-based CPU, Blackwell RTX graphics, and unified memory to run AI models and agents locally on PCs. The platform targets develo…
Nvidia unveiled the RTX Spark Superchip at Computex 2026, an ARM-based processor developed with MediaTek that promises to revolutionize Windows PCs for AI developers, creators, and gamers. The chip, f…
A developer argues that AI coding is shifting from cloud-based services to local infrastructure, citing GitHub's move to usage-based billing for Copilot, OpenAI's expansion of the Responses API into r…
AMD opened preorders for the Ryzen AI Halo developer mini PC at $3,999, featuring a Ryzen AI MAX+ 395 SoC with 128 GB unified memory, 2 TB storage, and a 50 TOPS NPU. The platform targets local AI dev…
Two NVIDIA DGX Spark units were clustered over a 200 GbE link to serve the Qwen3-30B-A3B-Thinking model using Ray and vLLM with tensor parallelism. The setup required pinning all transport layers to t…
A developer successfully clustered a 128 GB Mac Studio and a 128 GB DGX Spark using the open-source exo framework to run a model requiring 160 GB of memory, but the setup is limited to CPU-only infere…
Google DeepMind's DiffusionGemma, optimized for NVIDIA platforms, generates text tokens in parallel rather than sequentially, achieving up to 1,000 tokens per second on a single NVIDIA H100 GPU. The m…
NVIDIA has optimized Google DeepMind's new DiffusionGemma model to run up to four times faster on its GeForce RTX GPUs, RTX PRO workstations, and DGX Spark systems. Unlike traditional language models …
A buyer who spent roughly $10,000 on both a Mac Studio M3 Ultra with 512 GB of unified memory and a dual NVIDIA DGX Spark setup ran the same 397-billion-parameter model on each machine and measured th…
NVIDIA launched Enterprise Manageability for its DGX Spark and GB10 systems, providing IT teams with a complete operational framework covering the full lifecycle from provisioning to end-of-life retir…
A developer reports that running gpt-oss-120B on an NVIDIA DGX Spark (GB10) failed due to MXFP4 quantization lacking native hardware support on SM121, causing kernel hangs and memory spikes. Switching…
Nvidia's upcoming RTX Spark desktop, priced between $3,000 and $5,000, may not deliver the performance leap over the existing DGX Spark that marketing suggests, according to a skeptical analysis from …
GMKtec released the EVO-X2, a sub-$1,500 mini PC powered by AMD's Ryzen AI Max+ 395 processor with up to 128 GB of unified memory, enabling local operation of 70-billion-parameter AI models without a …
NVIDIA released the Jetson Orin Nano Super Developer Kit for $249, offering up to 67 TOPS of AI performance for edge computing and robotics. The tiny dev board runs the full NVIDIA AI software stack a…
Nvidia announced its new RTX Spark chip at Computex, a high-performance ARM-based processor for thin-and-light laptops and small desktops designed to compete directly with Apple's MacBook Pro lineup. …
Nvidia's DGX Spark, a compact personal AI supercomputer built around the GB10 Grace Blackwell Superchip, delivers up to 1 petaflop of FP4 AI performance and can run models up to 200 billion parameters…