Sovereign-Metal, a zero-dependency Python-to-Metal GPGPU advection engine and local transformer pipeline, has been released on GitHub under an MIT License. The engine enables zero-copy unified memory …
Mozilla AI released Llamafile 0.10.4, introducing Transcribefile built on the Transcribe.cpp speech-to-text inference library that supports 16+ TTS models. The update also includes improvements to Vul…
ZML launched LLMD, a free inference server that runs LLaMA, Gemma, Qwen, and Mistral models on NVIDIA, AMD, Google TPU, Intel, and Apple hardware from a single Docker image. Built in Zig and compiled …
A team rewrote a subset of the TinyGrad deep learning framework in Lean 4, creating TGrad, which outperforms the original in 4 of 5 benchmarks by up to 3x. The project demonstrates Lean 4's viability …
A researcher using nanoGPT on a MacBook Pro faces dependency failures when moving to a GPU cluster, prompting a solution using Nix and Flox to create reproducible, cross-platform runtime environments …
Developer Anil Madhavapeddy released ocaml-deepseek, an OCaml library that integrates DeepSeek's open-weight LLM directly into applications via a native inference engine, enabling local, dependency-fr…