MiniCPM5

OpenBMB released Desk-Pet, a local-first desktop pet application powered by the MiniCPM5 language model, allowing users to chat with a tiny companion on their desktop without requiring remote inferenc…

Mlx-optiq, a new open-source tool, enables per-layer mixed-precision quantization of large language models on Apple Silicon, allowing users to run, fine-tune, and serve LLMs locally on Macs without a …