22:00
2026-09-17
fratepietro.com
large-language-models
Bonsai: a 27B reasoning model on a 16 GB M2 Mac, with Frink
PrismML's Ternary-Bonsai-2-27B, a 27-billion-parameter reasoning model quantized to 1.75 bits per weight and 5.95 GB on disk, runs on a 16 GB M2 Mac through Frink v0.24.0, a pure-Rust GGUF inference eā¦