MLX-LM

Perplexity announced it will open source Lily, a local AI engine built for Apple silicon and the Qwen3.6-35B-A3B model, which uses a Rust runtime and custom Metal kernels without PyTorch or MLX. Perpl…

Cua's Metal capability shim recovers up to 16.36× llama.cpp throughput in macOS virtual machines by unmasking GPU capabilities that Apple's paravirtualized graphics device underreports. On an M1 Ultra…

Rondine, an open-source hardware-aware control plane, detects the host machine, recommends fitting models, builds an optimized serving plan, downloads weights, and starts an OpenAI-compatible local se…