Swiftlet

Swiftlet, a 10,000-line Swift and Metal project under Apache 2.0, runs Alibaba's Qwen3-Next-80B-A3B at 4-bit in 4.3GB of peak RAM on a Mac, decoding at 4.5–5 tokens per second on an M5, and runs the Q…

Swiftlet, a Swift + Metal runtime for Qwen3-Next and Qwen3.5/3.6 MoE hybrid models, runs an 80B Qwen in 4.3 GB of RAM on a Mac and a 35B on an iPhone 17 in about 2.5 GB of RAM at about 1 token per sec…