cd/entity/Gateway API Inference Extension· home› entities› Gateway API Inference Extension

grep -l @gateway api inference extension /news/*.json | wc -l → 2

Gateway API Inference Extension

mentions 2 type Person feed RSS

// recent coverage 2 mentions

12:00

2026-07-29

letsdatascience.com

artificial-intelligence

Microsoft Outlines a Three-Layer Agent Routing Stack for AKS

Microsoft's Azure Kubernetes Service engineering team published a reference implementation on June 29 that separates agent-request routing into three layers: semantic model selection via RouteLLM, gat…

15:27

2026-06-27

cefboud.com

large-language-models

Distributed LLM Inference with LLM-d

A new open-source tool called llm-d acts as an LLM-aware load balancer for distributed inference, intelligently routing requests across vLLM instances based on KV cache locality and GPU utilization. B…

// co-occurs with top 8 entities

vLLM 2 llm-d 1 SGLang 1 Kubernetes 1 Envoy 1 Prometheus 1 Microsoft 1 Azure Kubernetes Service 1

// topics top 6 topics

ai infrastructure 2 large language models 1 ai tools 1 ai research 1 artificial intelligence 1 ai agents 1