Google's AICore enables on-device LLMs like Gemini Nano by leveraging weight pruning and sparsity to reduce model size and power consumption. The Lottery Ticket Hypothesis guides pruning to identify c…
Ceva announced on July 6, 2026, that a major U.S. software and AI platform company licensed its NeuPro-M NPU IP for a custom AI silicon program targeting next-generation intelligent computing devices.…
AI infrastructure is entering a new phase focused on rack-scale system composition for agentic AI workflows, where CPUs play critical orchestration roles alongside accelerators. The shift from single-…
A developer benchmarked compile performance of Rust, Go, and TypeScript on a medium-sized project, finding Rust's cold build takes 3-5 minutes with high CPU usage, Go's build completes in under 10 sec…
Microsoft released Windows Subsystem for Linux (WSL) 3 as a beta preview at Build 2026, introducing paravirtualization to give Linux direct access to GPUs and NPUs without performance overhead. The up…
Researchers introduced llada.cpp, the first NPU-aware inference framework for accelerating diffusion large language models on smartphones, achieving 17x-42x latency reduction over CPU baselines while …
A developer built a real-time YOLOv8n UAV detection pipeline on the Rockchip RK3588S SoC that runs at 46 FPS using all three NPU cores, saturating the camera's frame rate. The pipeline uses only ~140 …
Qualcomm announced the Snapdragon C Platform for budget Windows-on-Arm laptops priced around $300, featuring a custom Kryo CPU and an integrated NPU for on-device AI, though the platform will not supp…
Microsoft released a preview update for Windows 11 that promises faster application launches and introduces new AI-powered features. The update adds Task Manager integration with the NPU (Neural Proce…
LiteRT, a cross-platform framework for on-device AI, enables developers to leverage Neural Processing Units (NPUs) for faster and more efficient AI features like real-time video effects and speech rec…