Fratepietro (auto-discovered)

Developer Antonello F. released Ferrox, a pure-Rust inference engine that runs open LLMs locally on CPU, Apple Metal, or CUDA, achieving performance parity with llama.cpp on an Apple M2 Pro: 26.9 tok/…

Rondine, a tool that detects hardware and configures inference engines, enables running GLM-5.2, a 744B-parameter Mixture-of-Experts coding model requiring approximately 245GB of memory, locally on a …

Rondine, an open-source hardware-aware control plane, detects the host machine, recommends fitting models, builds an optimized serving plan, downloads weights, and starts an OpenAI-compatible local se…