cd /news/ai-infrastructure/vllm-lets-compressed-tensors-block-f… · home › topics › ai-infrastructure › article
[ARTICLE · art-170258] src=runtimewire.com ↗ pub= topic=ai-infrastructure verified=true sentiment=↑ positive

vLLM lets compressed-tensors block-FP8 weights survive an engine restart

VLLM merged CUDA IPC weight-cache restart support on November 15th, 2026 for serialized compressed-tensors models using 128-by-128 block FP8 linear weights, letting a restarted engine map processed GPU weights and scales held through CUDA inter-process communication instead of rebuilding that prepared storage. The merged path restores the metadata required by the validated CUTLASS block-FP8 configuration, and exact greedy output was checked on a B300.

read1 min views1 publishedNov 16, 2026
vLLM lets compressed-tensors block-FP8 weights survive an engine restart
Image: Runtimewire (auto-discovered)

The merged change lets a restarted engine map processed CUTLASS block-FP8 weights through CUDA IPC, with exact greedy output checked on a B300.

        By [RuntimeWire Staff](https://runtimewire.com/author/runtimewire-staff)
        · Published 

vLLM merged CUDA IPC weight-cache restart support on November 15th, 2026 for serialized compressed-tensors models that use 128-by-128 block FP8 linear weights. The change lets a restarted engine map processed GPU weights and scales held through CUDA inter-process communication instead of rebuilding that prepared storage from scratch.

The merged path reuses processed weights and scales through CUDA IPC while restoring the metadata required by the validated CUTLASS block-FP8 configuration - explanatory diagram, not documentary evidence. RuntimeWire / AI-generated diagram.…

── more in #ai-infrastructure 4 stories · sorted by recency
── more on @vllm 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/vllm-lets-compressed…] indexed:0 read:1min 2026-11-16 · —