Inferact, the company founded by the creators and core maintainers of vLLM, is hiring a remote Member of Technical Staff for Cloud Orchestration with a salary of $200k–400k/yr. The role involves build…
A developer detailed deployment recipes for Qwen3.8-2.4T-A95B, a 2.4-trillion-parameter Mixture-of-Experts model with 95B active parameters, using vLLM. The guide covers verified GPU configurations, i…
The maintainers of the open-source vLLM inference engine at Inferact are hiring, according to a post praising the team as among the most skilled engineers globally. The post highlights their role in b…
Moonshot AI released the full weights and technical report for Kimi K3 on July 27th, documenting a 2.8 trillion-parameter model that activates 104 billion parameters per token. The Beijing developer h…
VLLM announces efficient day-0 support for Moonshot AI's Kimi K3, a 2.8-trillion-parameter Mixture-of-Experts model, achieving up to 370 tokens per second with speculative decoding on 16 NVIDIA GB300 …
Baseten has launched day-0 API support for Kimi K3, a new open frontier model from Moonshot AI with 2.8 trillion parameters, making it the largest open model to date. The API runs on NVIDIA GB300 NVL7…