A 26B Model in 2 GB of RAM, Courtesy of Your SSD
TurboFieldfare, a Swift-and-Metal runtime, runs Google's Gemma 4 26B-A4B model on Apple Silicon Macs with as little as 2 GB of RAM by streaming expert weights from SSD, achieving 5.1–6.3 tokens per se…