AI Infrastructure news and analysis on Web Pulse: 39078 curated articles tracking the latest AI Infrastructure developments, tools, and research, updated continuously from vetted sources.
Oracle Corp. has rebuilt its data stack around its Autonomous AI Lakehouse, an open layer that mounts other catalogs such as Databricks' Unity Catalog along with Postgres and MySQL databases so data is queried in place r…
A developer's analysis compares offloading the KV cache to NVMe against recomputing it for long-context LLM serving, calculating that a 70B model with grouped-query attention needs about 0.31 MB of cache per token — 2.5 …
New York in July 2026 became the first US state to pause approvals for new data centers of 50 MW or more while it studies their effects on power, water and ratepayers, according to the International Energy Agency's estim…
Moonshot AI published the full weights of Kimi K3.1 Pro on Hugging Face in the repo moonshotai/Kimi-K3.1-Pro, created November 2, 2026, delivering on its stated November 4 release date. The mixture-of-experts model carri…
Nodus published a worked analysis of the compute required to run reinforcement-learning training for LLM agents, showing that GPU cost is driven by idle time while tool calls execute in CPU sandboxes. In its example, 128…
DeepSeek open-sourced DeepInfer, the production inference engine behind its API that processes 155 trillion tokens per day, under the Apache 2.0 license. DeepInfer runs only DeepSeek-V4.1-Flash and requires NVIDIA SM100 …
VLLM introduced a fast-track RFC for managing AI-agent-generated GPU kernels after a Kimi K3 optimization fused decode operations on NVIDIA GB300 GPUs, cutting the kernel count from 23 stock kernels to 13 CuTe DSL kernel…
NVIDIA released the Eye Contact NIM, a microservice that uses AI models to redirect a user's gaze toward the camera in video frames to simulate natural eye contact. The NIM runs on CUDA, TensorRT and Triton for GPU accel…
NVIDIA released CUDA 13.5, moving NVIDIA Vera Rubin support from early developer access to general availability for enterprise production and extending Windows on Arm support, GA since CUDA 13.4, to NVIDIA DGX Station fo…
A developer released Sentinel AI Gateway, an open-source proxy that sits between internal applications and external LLM providers such as OpenAI, Anthropic and AWS Bedrock to scrub personally identifiable information and…
Broadcom announced an expansion of its VMware Cloud Foundation portfolio, adding AI infrastructure, security, and disaster recovery capabilities and introducing VMware vSphere Express, a virtualization product for small …
Confluent made Lightning Tables generally available on AWS on November 4th, 2026, adding Query as the fifth pillar of its Data Streaming Platform, according to the company's release notes. Lightning Tables is rolling out…
A reproducible benchmark on identical Google Cloud c3-standard-4 hardware found that the Go-based KTMS LLM gateway added less latency, used less memory and CPU, and started faster than LiteLLM Proxy v1.106.0 running on P…
Confluent, an IBM company, announced on November 4, 2026 new capabilities for building a "Streamhouse," a data architecture that keeps business context current for AI agents, applications and analytics, with Lightning Ta…
Unsloth co-founder Daniel Han released Dynamic v3.1 GGUFs for Qwen3.8-Flash-Next on November 4th, claiming the quantized files score 10-15% higher than GSQ-RCO on DeepSWE, Terminal Bench, Aider Polyglot and other tests i…
PhoenixAI co-founder and CEO James Li launched Contextbase on November 4th, 2026, a product that stores business definitions, knowledge, agent memory, run traces and evaluations in one governed system built into the Phoe…
Broadcom launched VMware vSphere Express, a 128-core package built on vSphere 9 for smaller environments, and added two Advanced Services to VMware Cloud Foundation: VMware Live Recovery and VMware Compliance and Configu…
Redis expanded Redis Iris on November 4th, 2026, with CEO Rowan Trollope announcing six capabilities for AI agents: Intent Router, Agent Playbooks, Agent Memory, Context Gateway, Lens and Agent Mesh, according to a Redis…
Cisco opened its Cisco IQ platform to partners with a suite of production REST APIs and a Model Context Protocol (MCP) server, announced at Partner Summit 2026, letting partners and AI agents consume the same contracts a…
A developer built LLM-Router, an open-source Rust binary that routes LLM requests across three home-network machines — a home server plus two gaming desktops — based on LLM load and server availability, with a preference…