Glad Labs fixed a GPU pinning issue where LiteLLM 1.89.2's global api_base override prevented per-model routing, causing vision tasks to cold-load onto the wrong GPU. The team also hardened content gu…
A Hacker News user asks the community for advice on moving from cloud-based AI services to private models for sensitive data analysis and reasoning, considering options like adding dual RTX 5090 GPUs …
Researchers introduced Hierarchical Global Attention (HGA), a method that reduces GPU memory usage in long-context transformers by using hierarchical routing, enabling a 64K-token context on an RTX 50…
Ahmad Osman, founder of Osmantic, argued at the AI Engineer World's Fair that local AI is rapidly catching up to proprietary frontier models, driven by shrinking gaps in open-source LLMs and improved …
GLM, the model family from Z.ai (formerly Zhipu AI), is gaining attention for its open weights and strong benchmark numbers. A developer tested GLM-4.7-Flash, a 30B-A3B MoE model, on a single-GPU home…
A technical analysis compares Mac hardware, Nvidia RTX 5090, and cloud services for running local large language models in 2026, warning consumers about spec-sheet traps that waste money.…
Gigabyte's $5,300 AORUS RTX 5090 Infinity, a limited-edition anniversary graphics card, is now available for in-store pickup at Micro Center in the US, but buyers will not receive the 1-gram 999 pure …
Amazon has dropped the Corsair Vengeance i5200 gaming PC featuring an RTX 5090 to its lowest price ever at $5,899.99, a $500 discount. The prebuilt system includes an Intel Core Ultra 9 285K, 64GB DDR…
NVIDIA Research released cuTile Rust, a tile-based system for writing memory-safe, data-race-free GPU kernels in Rust. The project extends Rust's ownership model to GPU programming, achieving up to 92…
Georgi Gerganov, creator of llama.cpp, reported that the Qwen3.6-27B model is highly capable for local coding tasks, using it daily on his M2 Ultra and RTX 5090 systems. He noted the model's utility f…
Newegg is offering a $845 discount on the ABS Kaze II Ruby gaming PC, which features an RTX 5090, Ryzen 7 9800X3D, 64GB DDR5, and 2TB SSD, bringing the price to $4,654.99. The deal includes a $600 ins…
Google DeepMind released DiffusionGemma, an open-source Apache 2.0-licensed diffusion-based large language model that generates text at over 1,000 tokens per second on a single H100 GPU, achieving up …
Amazon is offering the HP Omen Max 45L gaming desktop with an RTX 5090 graphics card and Ryzen 9 9900X3D processor for $600 off its regular price. The prebuilt system includes 32GB of DDR5 RAM, a 2TB …
NVIDIA Research and Tencent YoutuResearch have released open-source systems that replace the VAE decoder bottleneck in latent diffusion models, enabling faster 4K image generation. NVIDIA's PiD reform…
Google DeepMind released DiffusionGemma, a new AI model that generates text in parallel blocks rather than sequentially, achieving up to 700 tokens per second on an RTX 5090 GPU and over 1,000 tokens …
NVIDIA's RTX 5090, priced at $1,999, offers 32 GB of GDDR7 memory with 1,792 GB/s bandwidth, making it the fastest consumer GPU for both gaming and local AI inference. The card excels at running 32B-c…
A developer benchmarked quantum circuit simulation backends using a 20-qubit VQE workload on an NVIDIA RTX 5090 GPU, finding JAX/XLA 12.4x faster than PyTorch and 15.7x faster than TorchQuantum for po…
NVIDIA's RTX 5080 launched at $1,000 in January 2025 as a "sensible flagship" gaming card, offering 30-40% faster performance than the RTX 4080 Super with 16 GB of GDDR7 memory. The card is recommende…
A developer updated a homelab's local LLM stack, catching up llama.cpp by 469 builds and upgrading the Qwen generation model from 3.5 to 3.6, the embedding model from nomic v1.5 to v2-moe, and adding …
NVIDIA's DGX Spark desktop AI supercomputer, RTX 5090 consumer GPU, and RTX Spark laptop variant offer distinct trade-offs for local LLM inference in 2026. The RTX 5090 delivers dramatically higher to…