Donating KubeRay to the CNCF

The KubeRay team announced on November 9, 2026 that KubeRay is joining the Cloud Native Computing Foundation, bringing the full PARK stack — PyTorch, AI models, Ray and Kubernetes — under Linux Foundation governance. KubeRay is a Kubernetes operator providing three Custom Resource Definitions (RayCluster, RayJob and RayService) for running distributed Ray AI, machine learning and Python workloads on cloud-native infrastructure, and Spotify uses it to scale its internal machine learning platform, Hendrix, for training and fine-tuning models with Ray on GKE. The donation closes the last gap in the stack, since PyTorch and Ray already sit under the PyTorch Foundation and Kubernetes under the CNCF.

Donating KubeRay to the CNCF Andrew Sy Kim Google https://anyscale.com/blog?author=andrew-sy-kim-google , Edward Oakes https://anyscale.com/blog?author=edward-oakes , Kai-Hsun Chen https://anyscale.com/blog?author=kai-hsun-chen , Jui-An Huang https://anyscale.com/blog?author=jui-an-huang , Richard Liaw https://anyscale.com/blog?author=richard-liaw , Robert Nishihara https://anyscale.com/blog?author=robert-nishihara and The KubeRay team https://anyscale.com/blog?author=the-kuberay-team | November 9, 2026 The PARK stack PyTorch, AI models, Ray, and Kubernetes is emerging as the de facto open source standard for production AI. Within that stack, KubeRay https://github.com/kuberay-project/kuberay has become the bridge connecting scalable AI applications built on Ray with the compute orchestration of Kubernetes. Nearly every core piece of the PARK stack already lives under the Linux Foundation: PyTorch and Ray through the PyTorch Foundation, and Kubernetes through the Cloud Native Computing Foundation CNCF . KubeRay was the missing piece. Today, we’re announcing that KubeRay is joining the CNCF, bringing the entire PARK stack under Linux Foundation governance and giving teams full confidence in its neutrality and openness. LinkScaling Ray clusters on Kubernetes KubeRay is a powerful, open source toolkit and Kubernetes operator designed to run distributed AI, machine learning, and Python workloads powered by Ray seamlessly on cloud-native infrastructure. As distributed AI workloads become a core cloud native construct, KubeRay bridges the gap between Python-first AI frameworks and Kubernetes-native infrastructure. KubeRay provides three Kubernetes Custom Resource Definitions CRDs for scaling and operating Ray workloads in production: - RayCluster: The foundational building block for running Ray on Kubernetes. RayCluster manages the full lifecycle of a Ray cluster, automating head and worker pod provisioning, health checks, Global Control Service GCS fault tolerance, and dynamic autoscaling in coordination with the Ray Autoscaler. - RayJob: Purpose-built for batch processing, distributed training, and reinforcement learning RL workloads. RayJob automatically provisions an ephemeral RayCluster , submits a Ray job once the cluster is ready, and tears down the cluster upon completion to maximize compute and accelerator utilization. - RayService: Designed for long-lived, high-availability online inference with Ray Serve. RayService manages both the underlying RayCluster and the Ray Serve deployment graph, enabling zero-downtime rolling upgrades, automated failover, and seamless traffic routing for production AI services. Together, these custom resources provide the foundation for enterprises to build modern machine learning platforms on top of Ray and Kubernetes. For example, end users like Spotify use KubeRay to scale their internal machine learning platform, Hendrix, which is used to train and fine-tune Spotify’s machine learning models using Ray on GKE. “Running multimodal AI workloads at scale requires a platform with tight integration between Python-first AI and Kubernetes. KubeRay is that bridge, helping us scale reliably and manage complex agentic workflows At Hark, that is why we use it, and why I contribute: I want to help more builders scale production AI with confidence.” Kai-Hsun Chen, AI Infrastructure Lead, Hark LinkGrowing the KubeRay ecosystem Beyond core cluster lifecycle management, KubeRay has seen widespread adoption because of how deeply it integrates with other CNCF projects and the broader cloud-native ecosystem. Rather than reinventing infrastructure primitives, KubeRay plugs directly into the tools platform teams already rely on: - Observability with OpenTelemetry, Prometheus and Fluent Bit: Ray uses OpenTelemetry within its metrics pipeline and exposes metrics in Prometheus format, enabling platform teams running KubeRay to monitor cluster utilization, task execution, and Ray Serve latency alongside their existing Kubernetes infrastructure. Paired with Fluent Bit for lightweight log collection and forwarding, operators can easily aggregate distributed worker and job logs across ephemeral and long-lived Ray clusters. - Batch Scheduling and Quota Management with Kueue, Volcano, and KAI: As organizations scale distributed training across scarce GPU and TPU resources, KubeRay integrates natively with different schedulers to bring Kubernetes-native job queueing to RayJob and RayCluster . This enables gang scheduling all-or-nothing pod placement , multi-tenant resource quotas, priority preemption, and topology-aware scheduling. - Workload Security and Isolation: As AI workloads scale, robust security and multi-tenancy are critical. KubeRay provides the foundation to secure Ray clusters using automated mTLS and Kubernetes network policies. LinkWhat’s Next? KubeRay’s success so far has been due to its fast-growing community members -- we want to give thanks to everyone who has contributed to KubeRay so far. Becoming a CNCF sandbox project is just the beginning of KubeRay’s next chapter under open, vendor-neutral governance, and we’d love for you to be part of it. If you’re at KubeCon NA 2026, come meet the KubeRay maintainers at our Birds of a Feather BoF session https://events.linuxfoundation.org/kubecon-cloudnativecon-north-america/program/schedule/?id=1345967 to discuss the roadmap, share production use cases, and help shape the future of Ray on Kubernetes. Hark will also be giving a talk https://events.linuxfoundation.org/kubecon-cloudnativecon-north-america/program/schedule/?id=1337241 about how they use KubeRay for multimodal AI use cases as well. You can also connect with the community in the kuberay channel on the CNCF https://cncf-slack.netlify.app/ or Ray Slack workspaces https://www.ray.io/join-slack and attend our biweekly community meetings https://zoom-lfx.platform.linuxfoundation.org/meetings/ray .