FastH3 V2, an eight-step video-and-audio generation model whose weights previously required 138 GiB and data-center GPUs, now runs on a single consumer machine — an RTX 5090, RTX 4090, RTX PRO 6000, D…
Giga Computing opened GAIFA (GIGABYTE AI Factory Accelerator), its first proprietary AI computing center, in New Taipei City, Taiwan, a six-rack direct-liquid-cooled facility with a planned 700 kW fir…
Researchers introduced Bio-MF, a latent-free one-step MeanFlow framework for EEG-conditioned fNIRS generation, detailed in arXiv paper 2609.20904v1. On Dataset 1, EEG plus synthetic fNIRS improved acc…
NVIDIA listed the RTX PRO 5500 Blackwell, an 84GB GDDR7 ECC workstation card with 21,760 CUDA cores, 1,398 GB/s of bandwidth, 600W power draw and PCIe Gen 5, as "Coming Soon" on nvidia.com in Septembe…
NVIDIA added the RTX PRO 5500 "Blackwell" workstation GPU to its pro-viz lineup, featuring 84 GB of GDDR7 memory on a 416-bit bus delivering about 1,398 GB/s of bandwidth. The card uses a GB202 die wi…
A new DIY build, the Redundant Array of Inexpensive Videocards (RAIV), pools seven used AMD Instinct MI50 32GB GPUs for about €3,530 to run large local AI models with redundancy, as described by Wirke…
A new open-source tool called trimtab lets operators change SGLang and vLLM scheduler settings live, cutting configuration changes from a 1-7 minute redeploy to about 15 ms, with zero dropped requests…
A developer investigating a vLLM crash on workstation Blackwell GPUs found that FP8 KV cache kernels exceed the per-block shared-memory limit on sm_120 hardware, causing OutOfResources errors. The iss…
An engineer benchmarked Qwen3-8B on workstation Blackwell GPUs across three serving stacks, finding that vLLM outperformed SGLang and llama.cpp by up to 4x under load, and that an FP8 pass delivered a…
Researchers introduced Self-Geometry, a test-time adaptation method that enforces explicit epipolar consistency to improve vision foundation models' depth and pose predictions without full retraining.…
FreeToken, a new inference engine from FlashML, lets users run frontier models on gaming GPUs at interactive speeds, with Qwen3.6 35B running on an 8GB RTX 4060 laptop at 39 tokens per second, DeepSee…
Runware, the AI inference startup founded by Flaviu Radulescu and Ioana Hreninciuc, launched Sonic Inference Pods, modular data centers in 20-foot shipping containers that pack about 1,200 GPUs and on…
Fermisense, an AI consultancy, reports that a 9B Qwen specialist fine-tuned for $500 on two RTX PRO 6000 GPUs over three and a half days scored 87.3% on a simulated catalog-review benchmark, outperfor…
Nvidia released Cosmos-H-Dreams, an interactive generative model that lets researchers operate a surgical robot inside a synthesized video environment, generating action-conditioned video rollouts at …
CamelAI self-hosts DeepSeek V4 Flash on AWS spot instances to power its free tier, using g7e.24xlarge instances with four RTX PRO 6000 GPUs. The setup keeps free-tier costs fixed by avoiding per-token…
James O'Beirne's GitHub repo 'local-llm' documents his experience building and running large language models on local hardware, covering configurations from a $2k setup with two RTX 3090s to a $40k bu…
Fine-tuning a 70B parameter model like LLaMA 3.1 locally requires significant VRAM, with a full fine-tune needing roughly 1.1 TB before activations and realistically 8× H100/A100-80GB GPUs with ZeRO-3…
VRAM capacity and memory bandwidth, not AI TOPS, are the decisive specs for local LLM inference in mid-2026, according to an analysis by Ji-ho Choi. NVIDIA's RTX 5090 leads with 32 GB VRAM and 1792 GB…
ARCQuant, a new framework for Large Language Model inference, uses the NVFP4 numerical format to achieve up to 3x speedup on GPUs while maintaining accuracy comparable to full-precision baselines. The…
NVIDIA announced that its Confidential Computing technology for Blackwell GPUs achieves up to 98% of the inference performance of non-secure solutions, enabling hardware-rooted AI security without sig…