AI Infrastructure news and analysis on Web Pulse: 12609 curated articles tracking the latest AI Infrastructure developments, tools, and research, updated continuously from vetted sources.
As AI inference costs plummet—from $30 per million tokens in early 2023 to under $1 today—researchers at UC Berkeley led by Aditya G. Parameswaran argue that data systems must be redesigned for, of, and by AI agents. The…
The Rust Foundation published a position statement on artificial intelligence, outlining its belief that Rust can become synonymous with reliable, production-grade AI systems by leveraging memory safety and performance f…
A developer outlines cost optimization strategies for LLM features in production, noting that prototyping is cheap but scaling can lead to high bills. Tactics include routing requests by difficulty, caching responses, us…
AWS Graviton5-powered M9g and M9gd EC2 instances are generally available, with production benchmarks from Honeycomb, ClickHouse, and HubSpot showing consistent 36% performance gains over M8g. The new chiplet design on TS…
A developer shares practical patterns for managing multiple AI agents, transitioning from a single monolithic bot to a coordinated fleet. The guide covers using a message bus for inter-agent communication and leveraging …
Ollama, an AI platform that simplifies running open-source models locally, has reached 8.9 million developers and is used by 85% of the Fortune 500. The company raised $65 million in Series B funding led by an unnamed in…
NVIDIA's closed-source cuda-checkpoint tool, which freezes and restores CUDA processes, suffers from slow PCIe transfers. Engineers reverse-engineered the tool to understand why checkpoint transfers fail to saturate PCIe…
A technical guide explains how to build production AI agents with database-backed context retrieval and long-term memory, addressing the failure of demo agents at scale by architecting three memory layers: working memory…
OpenAI found roughly 30% of SWE-Bench Pro tasks broken, while Cognition announced SWE-1.7 rivaling GPT-5.5, shifting competition from model performance to benchmark control. A new runtime security layer emerged with tool…
XAI released Grok 4.5 on 8 July 2026, priced at $2 per million input tokens and $6 per million output tokens, making it roughly five times cheaper than competitors like Claude Fable 5 and GPT-5.5. The model ranks fourth …
Trigger.dev, an open-source platform for serverless asynchronous tasks, migrated its observability infrastructure from Postgres to ClickHouse to handle the growing volume of telemetry from long-running AI workflows. The …
AMD has published an analysis of network traffic patterns in AI training clusters, identifying congestion hotspots and harmonic-like oscillations caused by synchronized collective communication operations. The report exa…
Fastly announced a prototype to secure Model Context Protocol (MCP) servers, addressing AI-specific attack vectors, production-scale performance, and authentication complexity for a major global publisher. The solution c…
OpenAI released GPT 5.6 in three models—Sol, Terra, and Luna—now available on Vercel's AI Gateway. The models offer improved agentic capabilities in coding, biology, and cybersecurity with greater token efficiency. AI Ga…
Meta released Muse Spark 1.1, a multimodal reasoning model with a 1M token context window, now available on Vercel's AI Gateway. The model supports text, image, video, PDF, and audio inputs, and is designed for agentic t…
Claude Fable 5 can be used as an orchestrator in multi-agent workflows, delegating execution to cheaper models like Opus or Sonnet, cutting token costs by 10x without quality loss. The approach involves using Fable 5 for…
Context rot degrades AI agent output quality when a model's context window reaches 70-80% capacity, causing attention dilution and signal-to-noise loss. Anthropic's Claude Code addresses this with an auto-compact feature…
A new multi-agent workflow pattern uses Fable 5 as an architect for planning and Grok 4.5 as a construction crew for execution, cutting costs by shifting 90% of token spend to cheaper inference. The approach built a 50-d…
A new analysis distinguishes personal AI agents built for individual use from production AI agents designed for multiple users, highlighting that Markdown-based workflows fail at scale due to structural limitations in ha…
Palantir CEO Alex Karp argues that the AI bubble is deflating, with value shifting from data-providing companies to dominant platforms that engineered dependency through loss-leading API pricing and contract structures. …