22:00
2026-08-23
fratepietro.com
artificial-intelligence
Ferrox v0.9.1: a Rust GGUF engine, measured against llama.cpp
Ferrox v0.9.1, a pure-Rust GGUF inference engine, shipped today with MoE prefill on Apple Metal 2.4x faster, closing the gap to llama.cpp from 2.62x behind to 1.11x on OLMoE-1B-7B. The update also impโฆ