# DeepInfer, our in-house inference framework, now open source

> Source: <https://twitter.com/deepseek_ai/status/2112476496283775135>
> Published: 2026-10-20 10:12:46+00:00

DeepSeek on X: "🚀 Introducing DeepInfer, our in-house inference framework, now fully open source!
Powering DeepSeek-V4.1-Flash at scale with high throughput and low latency. We’re sharing our production stack to help the community lower compute costs, reduce energy use, and make AI more affordabl… / X

DeepSeek on X: "🚀 Introducing DeepInfer, our in-house inference framework, now fully open source!
Powering DeepSeek-V4.1-Flash at scale with high throughput and low latency. We’re sharing our production stack to help the community lower compute costs, reduce energy use, and make AI more affordable.
🔗 https://t.co/JGAik1kgk0
1/4"

🚀 Introducing DeepInfer, our in-house inference framework, now fully open source!
Powering DeepSeek-V4.1-Flash at scale with high throughput and low latency. We’re sharing our production stack to help the community lower compute costs, reduce energy use, and make AI more affordable.
🔗 github.com/deepseek-ai/De…
1/4

🚀 Introducing DeepInfer, our in-house inference framework, now fully open source!
Powering DeepSeek-V4.1-Flash at scale with high throughput and low latency. We’re sharing our production stack to help the community lower compute costs, reduce energy use, and make AI more affordable.
🔗 github.com/deepseek-ai/De…
1/4

🛠️ Also open-sourcing deepseek-recipe
Our production token encoding & decoding component, aligned with the processing logic behind the official DeepSeek API to bring the same API behavior to community deployments.
🔗 github.com/deepseek-ai/de…
3/4

🌍 Open models. Open kernels. Open inference.
From private deployments to public clouds, we’ll keep working with the community to make large-scale inference more efficient.
Explore the code, contribute, and build with us!
4/4
