# vLLM lets compressed-tensors block-FP8 weights survive an engine restart

> Source: <https://runtimewire.com/article/vllm-compressed-tensors-block-fp8-cuda-ipc-cache-restarts>
> Published: 2026-11-16 03:37:04+00:00

# vLLM lets compressed-tensors block-FP8 weights survive an engine restart

**The merged change lets a restarted engine map processed CUTLASS block-FP8 weights through CUDA IPC, with exact greedy output checked on a B300.**

        By [RuntimeWire Staff](https://runtimewire.com/author/runtimewire-staff)
        · Published 

vLLM merged CUDA IPC weight-cache restart support on November 15th, 2026 for serialized compressed-tensors models that use 128-by-128 block FP8 linear weights. The change lets a restarted engine map processed GPU weights and scales held through CUDA inter-process communication instead of rebuilding that prepared storage from scratch.

The merged path reuses processed weights and scales through CUDA IPC while restoring the metadata required by the validated CUTLASS block-FP8 configuration - explanatory diagram, not documentary evidence. RuntimeWire / AI-generated diagram.…
