DeepSeek has open-sourced DeepInfer, the Apache 2.0 inference framework that serves DeepSeek-V4.1-Flash in production. It targets NVIDIA SM100 GPUs and Huawei Ascend 950 NPUs, and ships offline inference only.
The post DeepSeek Open-Sources DeepInfer, the Inference Framework Behind DeepSeek-V4.1-Flash appeared first on MarkTechPost.
source & further reading
marktechpost.com — original article
Exa 3.0 Search API Tops Perplexity, Brave and Parallel on 8 Benchmarks
Cloudflare Releases Clairic, a System One Extraction Model on Workers AI
Inception Releases Mercury 3 Diffusion LLM at 1,068 Tokens per Second