AI Infrastructure news and analysis on Web Pulse: 32008 curated articles tracking the latest AI Infrastructure developments, tools, and research, updated continuously from vetted sources.
A freelance developer built an AI email assistant for a SaaS client and discovered that using GPT-4o for email classification at production volume cost $200-$375 per month for 50,000 emails. By switching to Global API, w…
Andreessen Horowitz (a16z) led a $33 million Series A investment in Telepatia, an AI-native clinical platform for Latin America that combines AI documentation, clinical decision support, and AI healthcare employees. The …
Odyssey, an AI lab developing world models for simulating physical environments, raised $310 million in Series B funding at a $1.45 billion valuation. Amazon led the round alongside AMD Ventures, GV, EQT, and In-Q-Tel, a…
A developer building a Model Context Protocol (MCP) server for a course catalog learned to distinguish between Tools, Resources, and Prompts. The team refactored their V2 implementation, which incorrectly exposed read op…
A developer built a Claude Code plugin that routes lightweight AI tasks to specialized small language models (SLMs) to reduce compute costs. The plugin intercepts requests and directs simpler queries to smaller, cheaper …
AI agent systems face a memory crisis due to the lack of a coherent memory model, with context windows acting as flat caches that waste tokens on irrelevant data. Engineers must adopt memory hierarchy concepts from compu…
AWS announced Context, a new reasoning engine for AI agents that provides structured, nuanced data to improve decision-making. The tool aims to enhance AI agent performance by enabling more sophisticated reasoning capabi…
Amazon is restructuring its AI division under new leader Peter DeSantis and investing up to $25 billion in Anthropic to catch up with OpenAI and Anthropic in frontier AI models. The company is also in talks with OpenAI f…
Eric Worrall published an essay on Watts Up With That claiming he used Claude to produce a simple game in 30 minutes for about $2 in token costs, and argued that multi-agent AI workflows could scale energy use from that …
AI demand is reshaping insurance risk for data centers, with McKinsey projecting nearly $7 trillion in global data-center investment by 2030 and Swiss Re forecasting insurance premiums to more than double to $24.2 billio…
Z.ai released GLM-5.2, a 753-billion parameter open-weights large language model optimized for long-horizon coding tasks. The model features an IndexShare architecture that reduces per-token compute FLOPs by 2.9 times at…
BrainGrid, an AI-powered platform for developers, reduced API costs by implementing Anthropic's ephemeral tool caching in AI SDK v5. By adding three lines of code to mark tool definitions as cacheable, the company cut to…
Shrijith Venkatramana, a developer building git-lrc, explains that NVIDIA Collective Communications Library (NCCL) is the critical infrastructure enabling multi-GPU training of large language models. NCCL provides optimi…
Odyssey, a world model AI startup founded by self-driving vehicle pioneers, raised $310 million in Series B funding at a $1.45 billion valuation, led by Natural Capital with participation from Amazon, AMD Ventures, and G…
AuthPlane, an open-source OAuth 2.1 and PKCE authorization server for the Model Context Protocol (MCP), launched as a single Go binary with built-in admin UI, DPoP support, and federation with existing identity providers…
Tensordyne, a Sunnyvale startup, announced its Napier (TDN) AI inference processor on June 15, claiming its TDN72 rack system delivers 13 times higher throughput and 17 times more tokens per watt than Nvidia's GB300 NVL7…
Amazon's custom Trainium and Inferentia chips are gaining traction as organizations seek cost-effective alternatives to Nvidia GPUs for AI workloads. AWS reports cost reductions of 80-90% for inference tasks on Inferenti…
Vercel released eve, an open-source framework for building and scaling AI agents where each agent is defined as a directory of files mapped to capabilities. The framework, published as an npm package under Apache-2.0, in…
Shoe company Allbirds is changing its name to Smartbird and pivoting to AI infrastructure, appointing former AWS quantum computing head Nadia Carlsten as CEO. The company sold its manufacturing equipment and laid off ret…
Uinta County commissioners unanimously approved a conditional-use permit for the 1.25-gigawatt Prometheus Hyperscale data center on 506 acres near Evanston, Wyoming, despite public skepticism about potential economic ris…