Mozilla AI released Llamafile 0.10.4, introducing Transcribefile built on the Transcribe.cpp speech-to-text inference library that supports 16+ TTS models. The update also includes improvements to Vul…
Trellis2.c, a native executable for local 3D generation with Vulkan and CUDA backends, has been released on GitHub. The project aims to provide a lightweight alternative to Python/PyTorch runtimes, si…
A developer details the challenges of achieving real-time 60 FPS video segmentation on Android, where each frame must be processed within 16.67 milliseconds. The post explores the use of heterogeneous…
A developer released an experimental Godot 4.7 project that runs Gemma 4 inference entirely in GDScript and Vulkan compute shaders, without external dependencies. The project is about an order of magn…
AMD's Ryzen AI Halo, a $3,999 desktop AI inference system with 128GB unified memory, launched July 10 at Micro Center, undercutting NVIDIA's DGX Spark by $700. Reviews confirm competitive performance …
Vulkan 1.4.356 introduces the VK_EXT_shader_ocp_microscaling_types extension, adding support for Open Compute Project Microscaling MX data types (MXFP4, MXFP6, MXFP8, MXINT8) to improve machine learni…
Transcribe.cpp, a C/C++ speech-to-text inference library, has been released supporting 16 model families and 60+ variants via GGUF models on the ggml runtime. It offers Metal, Vulkan, and CUDA backend…
Handy Computer released transcribe.cpp, an open-source ggml-based transcription library supporting over 60 ASR models with GPU acceleration via Vulkan, Metal, CUDA, and TinyBLAS. The library, created …
Samuel Yuan, a developer from MIT, released wavecat, a fully local personal AI agent that continuously watches a user's screen to understand their activity and goals, with all processing and data stor…
A developer built V.E.L.O.C.I.T.Y.-OS, a bare-metal operating system that runs entirely inside the CPU's L3 cache. The project includes a custom 30MB standalone IDE written in Rust that replaces VS Co…
Khronos Group presented an open standards roadmap at SIGGRAPH ASIA 2025 in Hong Kong, December 15-18, covering cross-platform ML inferencing acceleration, glTF Gaussian Splats, and OpenXR Spatial Enti…
Navatala Systems released Navatala GPU, an open-source cross-platform GPU compute runtime and kernel corpus supporting CUDA, HIP, Vulkan, OpenCL, and Metal backends. The alpha release includes Python …
A developer building Firefox 152.0.2 from source for Slackel 32-bit used Google AI to fix compilation errors. The AI identified a Vulkan handle mismatch and missing type includes, providing sed comman…
OpenAI's Whisper speech recognition model can run locally on a laptop CPU in real time, enabling offline dictation without sending audio to cloud servers. Off Grid AI Desktop is a free, open-source ap…
Sipp, an open-source AI inference library, enables running small local LLMs in browsers with up to 3x faster decode speeds than alternatives. Built by HCI and graphics programmers, it uses a unified A…
The open-source NVK Vulkan driver for Nvidia GPUs has merged experimental support for DLSS by importing pre-compiled CUDA binaries via the VK_NVX_binary_import extension, bypassing Nvidia's proprietar…
A developer discovered that FLUX.1-schnell GGUF models from city96's repository fail to load in stable-diffusion.cpp on AMD RX 580 8GB via Vulkan, while leejet's builds work. The error message 'new_sd…
A developer successfully ran a 35-billion-parameter Mixture-of-Experts model on a 2017 AMD RX 580 8GB GPU using Vulkan, bypassing CUDA and ROCm. The project, called Polaris Revival, achieved 17-18 tok…
The open-source NVIDIA NVK Vulkan driver merged support for Deep Learning Super Sampling (DLSS) into Mesa 26.2-devel, enabling DLSS on Linux/Steam Play for modern games. The implementation relies on t…
A developer successfully ran local AI inference on an AMD RX 580 (2017 GPU) using the Vulkan backend of llama.cpp and stable-diffusion.cpp, bypassing the lack of CUDA or ROCm support. The setup achiev…