cd/entity/Ferrox· home› entities› Ferrox
grep -l @ferrox /news/*.json | wc -l → 1

Ferrox

mentions 1 type Organization feed RSS

// recent coverage 1 mentions

09:00
2026-08-05
fratepietro.com
artificial-intelligence

Building a Rust Inference Engine That Matches Llama.cpp

Developer Antonello F. released Ferrox, a pure-Rust inference engine that runs open LLMs locally on CPU, Apple Metal, or CUDA, achieving performance parity with llama.cpp on an Apple M2 Pro: 26.9 tok/…

// co-occurs with top 7 entities
Antonello F. 1 llama.cpp 1 GGUF 1 Apple M2 Pro 1 Llama-3.1-8B 1 Qwen2.5-0.5B 1 SmolLM2-135M 1
// topics top 5 topics
artificial intelligence 1 machine learning 1 large language models 1 ai infrastructure 1 developer tools 1