Show HN: TurboQuant for mlx-lm (Apple Silicon)
A developer released TurboQuant, a pip-installable adapter for mlx-lm on Apple Silicon that uses a randomized Hadamard transform for data-oblivious, calibration-free quantization of weights and KV cac…
A developer released TurboQuant, a pip-installable adapter for mlx-lm on Apple Silicon that uses a randomized Hadamard transform for data-oblivious, calibration-free quantization of weights and KV cac…
A new open-source tool called mlx-chronos provides a standardized benchmark suite and community leaderboard for comparing local LLM inference engines on Apple Silicon Macs. The tool runs reproducible …
Mlx-Code, a new coding agent, natively integrates Git as its core state machine, enabling developers to branch, diff, and resume from any checkpoint. By mapping the reasoning loop onto Git mechanisms,…
The article describes a technical setup for running a local AI coding assistant (Aider) on Apple Silicon Macs using a custom Python server with the MLX library for direct RAM loading of language model…