A developer published a video and written guide showing how to run local AI models on a 16GB M1 MacBook Pro using the mlx-serve command-line utility, which is optimized for Apple's Metal architecture.…
Mark Murphy reports that mlx-serve, an Ollama-like inference server with a GUI, delivers a 4x speed increase for running Qwen 3.8 on his 64GB M2 Ultra Mac Studio compared to his previous Ollama setup,…
Mlx-serve, an open-source native LLM inference server for Apple Silicon written in Zig, shipped an update that adds compatibility with the Ollama API alongside existing OpenAI and Anthropic API suppor…
A developer released mlx-serve, a native Zig server for MLX-format language models on Apple Silicon, enabling local, free, and private use of AI coding assistants like Claude Code. The server exposes …