22:00
2026-08-23
fratepietro.com
ai-infrastructure
Frink on Metal: at parity with llama.cpp, and past it
Frink, a pure-Rust GGUF inference engine written by Antonello Frink, reached parity with llama.cpp on Apple Metal decode and passed it on prefill at version v0.12.0, with OLMoE-1B-7B prefill rising fr…