kvcache-ai

A community tester ran DeepSeek-V4-Flash-0731 on a Bosgame M5 mini PC with an RTX PRO 6000 Max-Q eGPU, achieving 44 to 60 tokens per second depending on quantisation, with no hyperscaler involved. The…

Moonshot AI's Kimi team and kvcache-ai have open-sourced AgentENV (AENV), a distributed platform for running agent environments at scale that powers agentic reinforcement learning (RL) training for Ki…

The MADSys Lab at Tsinghua University’s KTransformers project enables frontier-class MoE models like DeepSeek-R1 671B to run on commodity hardware with a CPU-GPU hybrid inference stack, achieving 286 …