[AINews] DeepSeek DeepInfer: Open Source SOTA Inference running 155T toks/day/cluster making $22m/day at ~80% margin for a 81 day payback
DeepSeek open-sourced DeepInfer, its production inference stack, on day one of PyTorch Conf, a vLLM customization that the company says serves 155 trillion tokens per day per cluster at roughly $38 per SM100/A950 card pe…