Apple M2 Pro

Developer Antonello F. released Ferrox, a pure-Rust inference engine that runs open LLMs locally on CPU, Apple Metal, or CUDA, achieving performance parity with llama.cpp on an Apple M2 Pro: 26.9 tok/…

Kokoro, an 82M-parameter text-to-speech model, now delivers high-quality, realistic speech generation locally on CPU, preserving privacy. The model supports multiple languages and 50 voices, and can b…