Nobody talks about RAM. Every local-LLM regret is a RAM problem.
A developer benchmarked local LLM memory usage on a Ryzen desktop with 32 GB of RAM and a 12 GB RTX 3060, finding that a 4.9 GB llama3.1:8b model reserved 7.0 GB of VRAM at a 32,000-token context window — a 43% "context …