09:22
2026-06-22
blog.doubleword.ai
large-language-models
FlashOffload: 7x Cheaper Prefills with Offloading
Researchers improved SGLang's offloading engine to achieve 7x cheaper prefill costs for DeepSeek V4 Flash on Grace Hopper systems, leveraging high CPU-GPU bandwidth to hide weight transfers behind com…