vLLM's op IR, or: where the inference engine meets the compiler
VLLM, a model-serving engine for large language models, introduced a small op-level IR to resolve the tension between acting as a compiler target and a hand-tuned kernel dispatcher. The IR allows vLLM to lower operations…