GMKtec's EVO-X3 AI workstation, featuring AMD Strix Halo, is shipping with delays and questionable VAT documentation, according to forum user ewook on Level1Techs. The user also questions whether addi…
A developer successfully ran DeepSeek-V4-Flash, a 284B-parameter mixture-of-experts model, on a 64GB AMD Strix Halo laptop by streaming cold experts from SSD via mmap. The model achieves ~1.9 tok/s de…
Ahmad Osman, founder of Osmantic, argued at the AI Engineer World's Fair that local AI is rapidly catching up to proprietary frontier models, driven by shrinking gaps in open-source LLMs and improved …
NVIDIA's DGX Spark, a $4,699 desktop AI supercomputer with 128GB unified memory, launched in 2025, offering one petaflop of FP4 performance. Benchmarks show it excels at prompt processing but lags in …
A 27B-parameter Qwen3.6-Coder model running on a consumer AMD Strix Halo mini-PC successfully fixed a bug in the LLMKube Kubernetes operator by correcting a hardcoded timeout that caused request failu…
Two machines with 128 GB of unified memory — the AMD Strix Halo and the NVIDIA DGX Spark — are being compared by owners who run 70B-parameter language models locally. AI developer u/Eugr benchmarked b…
A developer implemented FlashAttention's forward and backward passes from scratch in pure CUDA C++, achieving O(N) memory complexity through manual SRAM tiling and online softmax recurrence. A rejecte…