MiniCPM5

A benchmark test by an unnamed developer found that LLM concurrency scales on consumer hardware, with pooled agents multiplying throughput by up to 8.7x, and the top result being MiniCPM5 1B at 983 to…

OpenBMB released Desk-Pet, a local-first desktop pet application powered by the MiniCPM5 language model, allowing users to chat with a tiny companion on their desktop without requiring remote inferenc…

Mlx-optiq, a new open-source tool, enables per-layer mixed-precision quantization of large language models on Apple Silicon, allowing users to run, fine-tune, and serve LLMs locally on Macs without a …