22:00
2026-09-17
fratepietro.com
large-language-models
A 27B model in 5.5 GB: Bonsai ternary on Ferrox, locally
Ferrox v0.23.0, released today, adds support for PrismML's Ternary-Bonsai-2-27B, a 27-billion-parameter model quantized to 1.75 bits per weight that occupies 5.5 GB on disk and runs on a 16 GB laptop,…