Shouldn't AI Move From Cloud to Local Compute?
A developer argues that AI coding is shifting from cloud-based services to local infrastructure, citing GitHub's move to usage-based billing for Copilot, OpenAI's expansion of the Responses API into r…
A developer argues that AI coding is shifting from cloud-based services to local infrastructure, citing GitHub's move to usage-based billing for Copilot, OpenAI's expansion of the Responses API into r…
AMD opened preorders for the Ryzen AI Halo developer mini PC at $3,999, featuring a Ryzen AI MAX+ 395 SoC with 128 GB unified memory, 2 TB storage, and a 50 TOPS NPU. The platform targets local AI dev…
Two NVIDIA DGX Spark units were clustered over a 200 GbE link to serve the Qwen3-30B-A3B-Thinking model using Ray and vLLM with tensor parallelism. The setup required pinning all transport layers to t…
A developer successfully clustered a 128 GB Mac Studio and a 128 GB DGX Spark using the open-source exo framework to run a model requiring 160 GB of memory, but the setup is limited to CPU-only infere…
Google DeepMind's DiffusionGemma, optimized for NVIDIA platforms, generates text tokens in parallel rather than sequentially, achieving up to 1,000 tokens per second on a single NVIDIA H100 GPU. The m…
NVIDIA has optimized Google DeepMind's new DiffusionGemma model to run up to four times faster on its GeForce RTX GPUs, RTX PRO workstations, and DGX Spark systems. Unlike traditional language models …
A buyer who spent roughly $10,000 on both a Mac Studio M3 Ultra with 512 GB of unified memory and a dual NVIDIA DGX Spark setup ran the same 397-billion-parameter model on each machine and measured th…
NVIDIA launched Enterprise Manageability for its DGX Spark and GB10 systems, providing IT teams with a complete operational framework covering the full lifecycle from provisioning to end-of-life retir…
A developer reports that running gpt-oss-120B on an NVIDIA DGX Spark (GB10) failed due to MXFP4 quantization lacking native hardware support on SM121, causing kernel hangs and memory spikes. Switching…
Nvidia's upcoming RTX Spark desktop, priced between $3,000 and $5,000, may not deliver the performance leap over the existing DGX Spark that marketing suggests, according to a skeptical analysis from …
GMKtec released the EVO-X2, a sub-$1,500 mini PC powered by AMD's Ryzen AI Max+ 395 processor with up to 128 GB of unified memory, enabling local operation of 70-billion-parameter AI models without a …
NVIDIA released the Jetson Orin Nano Super Developer Kit for $249, offering up to 67 TOPS of AI performance for edge computing and robotics. The tiny dev board runs the full NVIDIA AI software stack a…
Nvidia announced its new RTX Spark chip at Computex, a high-performance ARM-based processor for thin-and-light laptops and small desktops designed to compete directly with Apple's MacBook Pro lineup. …
Nvidia's DGX Spark, a compact personal AI supercomputer built around the GB10 Grace Blackwell Superchip, delivers up to 1 petaflop of FP4 AI performance and can run models up to 200 billion parameters…
NVIDIA's DGX Spark desktop AI supercomputer, RTX 5090 consumer GPU, and RTX Spark laptop variant offer distinct trade-offs for local LLM inference in 2026. The RTX 5090 delivers dramatically higher to…
Microsoft announced the Surface RTX Spark Dev Box at Build today, a desktop device powered by NVIDIA's RTX Spark chip designed for sustained AI workloads like long-running training jobs and local mode…
NVIDIA's DGX Spark workstation can be linked via a single 200 GbE cable to form a two-node AI cluster, aggregating 256 GB of unified memory to run frontier-scale models like Llama 3.1 405B locally. Th…
NVIDIA's DGX Spark single-node AI appliance can run OpenAI's open-weight GPT-OSS-120B sparse MoE model at ~50 tokens/s using optimized engines like SGLang or llama.cpp, making it viable as a local cod…
Developer Matt Coles has built lgtmaybe, a provider-agnostic PR reviewer supporting six model backends with a single --provider flag, shipping as a PyPI CLI and GitHub Action. He also maintains a home…
A developer used a local Japanese sentiment AI (BERT) to analyze 87,621 messages from an 8-year LINE chat history, running entirely on a DGX Spark to keep the private conversation data on-device. By s…