AVX2

A developer built a C99 inference engine that runs DeepSeek-V4-Flash, a 284B-parameter mixture-of-experts model, on a laptop with just 3.2GB of RAM by streaming weights off NVMe and caching only the e…

Llambda.lisp, a pure Common Lisp inference engine for running quantized large language models from .gguf files, achieves C-level throughput using AVX2/FMA acceleration and multi-threading without wrap…

A developer built Micro-Expert-Router, a Rust inference engine that streams Mixture-of-Experts model weights directly from NVMe SSDs using io_uring with O_DIRECT, eliminating the need for GPU VRAM. Th…