LLM VRAM requirements: what fits on 8, 16, 24, 48 and 80GB
A developer published a tier-by-tier breakdown of which large language models fit on 8GB, 16GB, 24GB, 48GB and 80GB of GPU VRAM, assuming standard 4-bit (Q4_K_M) quantization with moderate context hea…