18:07
2026-07-17
netflixtechblog.medium.com
large-language-models
In-House LLM Serving at Netflix
Netflix's AI Platform team built an in-house LLM serving stack, running the full pipeline from model deployment through inference inside its existing production environment. The team selected vLLM as …