Homebench

Homebench, a local LLM benchmarking tool, tested five models on an RTX 3060 12GB, finding Qwen 2.5 7B fastest at ~58 tokens/sec and LLaMA 3 8B highest quality at 8.2/10, while Mistral Nemo 12B underpe…

Homebench, a new open-source command-line tool, benchmarks local large language models for speed, memory, and quality, presenting results in a live terminal leaderboard. The tool, installable via pip,…