Hi everyone,
I built FitCheck to answer a common question before starting an LLM job:
Will this configuration fit in my GPU’s memory?
FitCheck estimates peak VRAM for LoRA, QLoRA, and full fine-tuning. It reports the memory breakdown, usable GPU capacity, headroom, fit verdict, and largest estimated micro-batch that fits.
It also supports serving estimates based on model weights and KV cache, plus an advisor that explores batch size, sequence length, and LoRA rank.
FitCheck reads the model’s Hugging Face config.json and parameter-count metadata. It does not download model weights or require PyTorch, CUDA, or a GPU to run the estimate.
I tested the estimator against real GPU measurements. Across 57 calibration and repeat runs, the full-process estimate has a 2.4% mean absolute error and a 13.9% worst absolute error. A separate 12-run holdout has a 5.4% mean absolute error and produced 12/12 correct fit-boundary verdicts for the tested setup.
The current measurements are all from one Tesla T4, so this is not a universal accuracy claim. FitCheck is a sizing tool, not a guarantee that every workload will avoid an OOM.
Try the Space: FitCheck - a Hugging Face Space by mlanvvs GitHub and technical details: GitHub - Anassbzdd/fitcheck: See if your LLM fits in your GPU's VRAM before it — no more guessing or OOM errors. · GitHub
Install: pip install fitcheck-llm
I would appreciate feedback, especially:
Is the result easy to understand?
Which models or configurations should I test next?
Does the estimate match your measured GPU usage?
Positive or critical feedback is welcome. My goal is to find where the estimator is wrong and improve it with reproducible measurements.