Lowvram: A CLI tool to run large AI models in low VRAM GPUs
A developer released lowvram, an open-source CLI tool that intercepts CUDA calls via LD_PRELOAD and redirects cuMemAlloc to cuMemAllocManaged so applications can run on GPUs with less VRAM than they require. On an NVIDIA…