MiniCPM-V

A developer detailed a sequential model-loading approach to run Whisper, bge-m3, and Gemma on a single local workstation with limited VRAM, avoiding out-of-memory errors by loading and unloading model…

A new MLIR-based compilation method for large language models, developed by researchers and implemented in the TPU-MLIR compiler and LLM-TPU deployment project, addresses challenges in importing train…

Serenity, an autonomous AI agent built with a memory system inspired by biological neural processes rather than traditional databases, can now run entirely on local consumer hardware without cloud con…