My RTX 5090 Fell from 77 to 7 Tokens Per Second. VRAM Pressure Was the Culprit
A 27B NVFP4-quantized model served by vLLM on a Windows 11 desktop with an RTX 5090 (32 GB VRAM) dropped from roughly 77 tokens per second to about 7 tokens per second during Microsoft Teams video calls, with no out-of-m…