Kubeflow 1.11, released at KubeCon Japan, introduces a pip-installable SDK that lets ML practitioners submit distributed training jobs, run hyperparameter searches, and fine-tune Llama 3.2 without wri…
Netflix detailed its in-house LLM serving platform built on Triton and vLLM, revealing how it handles real-time and batch inference across CPUs and GPUs while managing version compatibility and constr…
Google Cloud open-sourced k8s-aibom, an unprivileged Kubernetes controller that automatically detects running AI runtimes and generates CycloneDX Machine Learning Bill of Materials (ML-BOMs) from live…
SkyPilot launched SkyPilot Endpoints, a production-ready LLM inference system that deploys and manages inference across multiple Kubernetes clusters from a single YAML specification. The system handle…
OpenTelemetry's graduation to stable status within the CNCF provides a standardized observability framework for production LLM pipelines, addressing challenges in tracing inference requests across vec…
A developer has created a checklist for mining GitHub issues to extract UX research findings from engineering conversations. The framework involves coding each issue with metadata such as user persona…
The article explains that GitHub mining, or repository mining, is a research method used to analyze data from GitHub repositories—such as issues, pull requests, and discussions—to understand real user…
The article describes the author's work building NeuroScale, a self-service AI inference platform that manages complex Kubernetes infrastructure for deploying models like Gemma 4. The author explains …
The article describes the revival of NeuroScale, a broken MLOps platform that was abandoned in April 2026 after Backstage, ArgoCD, and KServe all failed. The author rebuilt it into a self-service AI i…