Ai Infrastructure

At Google I/O 2026, the company announced Gemini 3.5 Flash is now generally available, positioning it as its strongest model for agentic and coding workloads with 1M-token context and four thinking levels. Google also in…

Vercel released an AI Gateway plugin for WordPress that provides access to hundreds of AI models from over 40 providers through a single API key. The plugin integrates with the new WordPress AI Client, which requires the…

At the Google I/O conference, NVIDIA and Google Cloud announced new resources for their joint developer community of over 100,000 members, including learning paths for JAX on NVIDIA GPUs and an NVIDIA Dynamo codelab for …

Vlad Feinberg published a guide on how to land a job at a frontier AI lab focused on pretraining, emphasizing kernel-level performance work as the most direct path into the labs. The guide recommends deriving Chinchilla …

Vercel has added Gemini 3.5 Flash to its AI Gateway, offering developers access to the model with improved coding proficiency, reasoning, and multi-turn coherence. The model defaults to a medium thinking level to balance…

Together Inference Engine delivered 31% more tokens per second than the next fastest open-source inference engine on the same hardware during a production coding agent workload, while maintaining twice the time-to-first-…

Anthropic and Vercel launched a new integration allowing developers to run Claude Managed Agents within Vercel Sandbox, providing isolated execution environments for AI agent tool calls. The setup runs each agent session…

NVIDIA CEO Jensen Huang told Dell Technologies World attendees Monday that demand for AI is "going parabolic, utterly parabolic," as the industry shifts from pilot programs to large-scale agentic AI and inference deploym…

NVIDIA founder and CEO Jensen Huang introduced the standalone Vera CPU at GTC San Jose in March as the company's next multibillion-dollar business, and the first units arrived at three leading AI labs on Friday. NVIDIA V…

PyTorch 2.11 now enables direct installation of CUDA-enabled PyTorch wheels on aarch64 Linux from PyPI, eliminating the need for custom package indexes and workarounds that previously complicated deployment on NVIDIA GH2…

The ExecuTorch MLX delegate now enables GPU-accelerated inference for PyTorch models on Apple Silicon Macs through Apple's MLX framework. The new backend achieves 3-6x higher throughput on generative AI workloads compare…

Cerebras completed its IPO this week, with shares closing at $280 for a $60 billion market capitalization, following a pulled S-1 filing and a major partnership with OpenAI. The company’s CFO Bob Komin stated Cerebras se…

The hottest job in artificial intelligence now pays $630,000 and does not involve building models. Former Google CEO Eric Schmidt said the role of a frontier data engineer is the most sought-after position in the industr…

Together AI and Pearl Research Labs have partnered to launch a new AI inference endpoint for the Gemma-4-31B-it-pearl model, offering over 25% discounts by offsetting costs through cryptocurrency mining. The Pearl Networ…

Vercel has added a new sorting feature to AI Gateway that allows developers to rank model providers by cost, latency (time to first token), or throughput (tokens per second). The sorting is computed at request time, auto…

PyTorch 2.12 introduces a new device-agnostic `torch.accelerator.Graph` API that unifies graph capture and replay across CUDA, XPU, and out-of-tree backends. The release delivers up to 100x faster batched eigenvalue deco…

NVIDIA and Ineffable Intelligence, the London-based AI lab founded by AlphaGo architect David Silver, announced a collaboration to build infrastructure for large-scale reinforcement learning. The partnership will focus o…

Nous Research released Hermes Agent, an open-source AI agent framework that crossed 140,000 GitHub stars and became the most-used agent on OpenRouter, designed for self-improvement and reliability on local hardware. The …

Vercel has introduced natural language support for its Firewall, allowing users to create WAF custom rules by describing the desired behavior in plain text. The feature generates rules that can log, block, challenge, rat…

Arm has released a set of hands-on Jupyter labs demonstrating how to deploy AI models on edge devices using ExecuTorch, an extension of the PyTorch ecosystem designed for local inference on constrained hardware. The labs…