{"slug": "nvidia-gets-back-on-the-horse-with-ai-inference-pledge", "title": "Nvidia gets back on the horse with AI inference pledge", "summary": "Nvidia joined AMD, Intel, Google, Meta, and Cloudflare as an inaugural member of the SGLang Consortium, a project from nonprofit LMSYS Org built around its full-stack SGLang inference engine for frontier AI models. Consortium members will work with SGLang's maintainers on frontier model support, reasoning and multimodal workloads, distributed inference, and hardware optimization. Nvidia VP of hyperscale and high-performance computing Ian Buck said \"better software helps developers get more performance from Nvidia compute\" and that lower inference costs make AI more accessible.", "body_md": "In news that may be overshadowed [by certain other events at the company](https://www.sdxcentral.com/news/nvidia-ceo-jensen-huang-resigns/), Nvidia announced its membership in an initiative focused around open-source AI inferencing.\n\nThe chip giant is an inaugural member of SGLang Consortium, a project from nonprofit LMSYS Org that also includes AMD, Intel, Google, Meta, and Cloudflare.\n\nAccording to LMSYS, the venture centers around its full-stack SGLang inference engine designed for frontier AI models. Members will explore emerging inference AI trends with SGLang’s maintainers and \"turn shared priorities into joint engineering work, focused on frontier model support, reasoning and multimodal workloads, distributed inference, and hardware optimization.\"\n\n“The teams running SGLang at the largest scale see what inference needs next before anyone else does,” Ying Sheng, co-author of the original SGLang paper and co-founder and CEO of RadixArk, explained. “With the challenges in building new data centers, software approaches to improve AI efficiency will be incredibly important. These lessons will benefit every SGLang user and advance the AI ecosystem.”\n\n\"Better software helps developers get more performance from Nvidia compute. Open models enable them to build new applications and businesses. And lower inference costs make AI more accessible to organizations everywhere,” Ian Buck, VP of hyperscale and high-performance computing at Nvidia, added.\n\nPrior to his departure from Nvidia, [now ex-CEO Jensen Huang](https://www.sdxcentral.com/news/nvidias-ultra-low-latency-ai-inference-lpx-racks-hit-full-production/) described inference as the \"growth engine of AI.\" The comments came as the chip vendor unveiled its LPX racks for AI inference accelerators in September, with Huang claiming its Vera Rubin platform offered \"workload-optimized AI factory configurations designed for the era of agentic AI, advancing the performance frontier with LPX for ultrafast token generation.”", "url": "https://wpnews.pro/news/nvidia-gets-back-on-the-horse-with-ai-inference-pledge", "canonical_source": "https://www.sdxcentral.com/news/nvidia-gets-back-on-the-horse-with-ai-inference-pledge/", "published_at": "2026-11-13 15:20:54+00:00", "updated_at": "2026-11-13 15:50:44.600326+00:00", "lang": "en", "topics": ["artificial-intelligence", "ai-infrastructure", "ai-chips", "large-language-models", "ai-tools"], "entities": ["Nvidia", "SGLang Consortium", "LMSYS Org", "AMD", "Intel", "Google", "Meta", "Cloudflare"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/nvidia-gets-back-on-the-horse-with-ai-inference-pledge", "markdown": "https://wpnews.pro/news/nvidia-gets-back-on-the-horse-with-ai-inference-pledge.md", "text": "https://wpnews.pro/news/nvidia-gets-back-on-the-horse-with-ai-inference-pledge.txt", "jsonld": "https://wpnews.pro/news/nvidia-gets-back-on-the-horse-with-ai-inference-pledge.jsonld"}}