13:50
2026-09-16
discuss.huggingface.co
large-language-models
Which open models actually fit a 12 GB card? We measured instead of guessing
AI Model Radar published measurements on 16 September 2026 showing that the standard rule-of-thumb for estimating context-cache memory in open-weights models can be off by a factor of four, and by rouβ¦