Apple M5 Pro

A new open-source project, microgpt, implements a character-level GPT in a single dependency-free C file, achieving 10,168,430 tokens per second on an Apple M5 Pro with NEON and 6,927,775 tokens per s…

DeepSeekV4SSD, an experimental app from developer yanun0323, streams routed experts from SSD to run all 284 billion parameters of DeepSeek-V4-Flash-0731 on an M-series Mac with about 30 GB of memory, …

Thoughtworks technologist Birgitta Böckeler tested running local large language models for agentic coding on Apple M3 Max and M5 Pro machines, finding that while RAM constraints limit model size to 15…