Nano-vLLM

A guide outlines five hands-on projects for learning LLM inference engineering, starting with rebuilding a vLLM-style engine from the educational Nano-vLLM implementation and progressing through a Tri…

Researchers introduced ACache, an affix-oriented cache reuse mechanism for Diffusion Large Language Models (DLLMs) that selectively recomputes key-value states of critical Anchor Tokens to maintain ac…