DeepInfer, our in-house inference framework, now open source

DeepSeek has open-sourced DeepInfer, its in-house inference framework that powers DeepSeek-V4.1-Flash at scale with high throughput and low latency, publishing the code at github.com/deepseek-ai. DeepSeek said it is sharing its production stack to help the community lower compute costs, reduce energy use, and make AI more affordable. DeepSeek also open-sourced deepseek-recipe, its production token encoding and decoding component aligned with the processing logic behind the official DeepSeek API, to bring the same API behavior to community deployments.

DeepSeek on X: "🚀 Introducing DeepInfer, our in-house inference framework, now fully open source Powering DeepSeek-V4.1-Flash at scale with high throughput and low latency. We’re sharing our production stack to help the community lower compute costs, reduce energy use, and make AI more affordabl… / X DeepSeek on X: "🚀 Introducing DeepInfer, our in-house inference framework, now fully open source Powering DeepSeek-V4.1-Flash at scale with high throughput and low latency. We’re sharing our production stack to help the community lower compute costs, reduce energy use, and make AI more affordable. 🔗 https://t.co/JGAik1kgk0 1/4" 🚀 Introducing DeepInfer, our in-house inference framework, now fully open source Powering DeepSeek-V4.1-Flash at scale with high throughput and low latency. We’re sharing our production stack to help the community lower compute costs, reduce energy use, and make AI more affordable. 🔗 github.com/deepseek-ai/De… 1/4 🚀 Introducing DeepInfer, our in-house inference framework, now fully open source Powering DeepSeek-V4.1-Flash at scale with high throughput and low latency. We’re sharing our production stack to help the community lower compute costs, reduce energy use, and make AI more affordable. 🔗 github.com/deepseek-ai/De… 1/4 🛠️ Also open-sourcing deepseek-recipe Our production token encoding & decoding component, aligned with the processing logic behind the official DeepSeek API to bring the same API behavior to community deployments. 🔗 github.com/deepseek-ai/de… 3/4 🌍 Open models. Open kernels. Open inference. From private deployments to public clouds, we’ll keep working with the community to make large-scale inference more efficient. Explore the code, contribute, and build with us 4/4