llm-d

NVIDIA open-sourced Grove, a Kubernetes API for managing multi-component AI inference stacks, at KubeCon Europe 2026. Grove introduces custom resources for gang scheduling, topology-aware placement, a…

IBM Research, Red Hat, and NxtGen Cloud Technologies demonstrated that using llm-d to serve AI models on mixed GPU hardware can boost inference speeds by 3 to 5 times and double throughput, enabling e…