The InstaTunnel engineering team developed an eBPF-based socket steering solution to preserve QUIC connection migration across load-balanced worker processes. By teaching the kernel to route packets b…
The Cloud Native Computing Foundation (CNCF) has elevated OpenTelemetry to its highest maturity level, graduating the project as production-ready for enterprise use. The milestone recognizes OpenTelem…
A new open-source tool called llm-d acts as an LLM-aware load balancer for distributed inference, intelligently routing requests across vLLM instances based on KV cache locality and GPU utilization. B…
Modal introduced Servers, a new ultra-low-latency HTTP serving solution for serverless applications, built on Pingora, Envoy, and Spanner. The system minimizes overhead by avoiding control-plane looku…
Grab's cybersecurity and platform engineering teams built Palana, a Kubernetes-native secure execution platform, to safely run autonomous AI workloads by implementing deterministic guardrails and zero…
Intel released Optimization Zone 1.1, a centralized repository of tuning guides for maximizing performance on Intel Xeon processors and some desktop CPUs. Newly covered workloads include Apache Cassan…
AI code scanners become trustworthy only when fed explicit threat models, according to a cross-domain analysis of autonomous systems. Production agents require distributed-systems rigor including idem…
Solo.io has launched agentgateway, a unified high-performance gateway designed to manage MCP, A2A, LLM, and API traffic through a single operational layer. The new gateway addresses infrastructure cha…
The Cloud Native Computing Foundation highlighted a new AI-assisted migration approach that enabled engineers to migrate 60 ingress-nginx resources to the Higress API gateway in roughly 30 minutes. Th…