AI Infrastructure

Computing pioneer David Patterson, a former UC Berkeley computer science professor and now a distinguished engineer and fellow at Google, said at the AI Infra Summit that Jensen Huang is "unquestionably" right that Moore…

Cohere CEO Aidan Gomez said at the ALL IN conference in Montréal on Wednesday that the Toronto-based AI developer will not build its own chips, telling Bloomberg AI reporter Rachel Metz, "We don't want to get into the sp…

Ferrox v0.23.0, released today, adds support for PrismML's Ternary-Bonsai-2-27B, a 27-billion-parameter model quantized to 1.75 bits per weight that occupies 5.5 GB on disk and runs on a 16 GB laptop, making Ferrox the f…

Vercel posted a Software Engineer, Agentic Infrastructure role paying $196,000 to $294,000 per year plus equity, hybrid in San Francisco or New York City, requiring 3+ years of backend and distributed systems experience.…

A developer guide evaluates five LLM routing tools—Bifrost, LiteLLM, Kong AI Gateway, Cloudflare AI Gateway, and OpenRouter—for directing inference requests across multiple model providers to avoid rate limits, latency s…

Researchers disclosed a class of configuration injection flaws in September 2026 affecting AI coding agents including Claude Code, Codex, Goose, Qwen Code and Grok Build, tracked as CVE-2026-19592, in which a crafted rep…

A developer published a step-by-step guide and open-source MCP toolkit for deploying Google's Gemma 4 E2B model to a single AMD Instinct MI300X GPU rented through AMD Developer Cloud at $1.99 per hour. The vLLM-based set…

Frontier AI labs are confronting cognitive compaction vulnerabilities, macroeconomic debt pressures, and a re-engineering of compute silicon and financial rails as consumer adoption of personal AI agents accelerates thro…

Microsoft's Azure Kubernetes Service engineering team open-sourced TauGrid on August 28, 2026, under the MIT license at Azure/taugrid, a Kubernetes-native platform for running AI workloads that bundles the tau CLI, Kueue…

The U.S. semiconductor industry needs roughly 157,000 additional workers to meet soaring AI chip demand, according to CNBC. Chipmakers and U.S. universities are pursuing programs aimed at closing that talent gap in domes…

Maxim AI's Bifrost, an open-source AI gateway written in Go, leads a 2026 comparison of model routing tools, adding only 11 microseconds of overhead at a sustained 5,000 requests per second. The guide argues that routing…

Baseten's Base Labs research arm launched an open-weight AI safety partnership with Hugging Face and Goodfire on September 17th, aiming to develop and publish public methods for training, evaluating and monitoring open m…

TerraWatt, developer of a proposed $3.1 billion, 120-megawatt data center in St. Louis, Missouri, sued the St. Louis Board of Adjustment on Wednesday after the five-member panel required the company to supply at least 2.…

Intel researchers compressed a 1.58-bit large language model to an effective 1.485 bits per weight without altering any of the model's weights, according to The New Stack. The technique reduces the model's memory footpri…

OpenAI managing director George Osborne said Canada is an "obvious place" for data centre development, praising the country's efforts to solicit international investment and boost AI adoption. The remarks position Canada…

A new wave of autonomous AI agents is driving interest in AI-to-AI payment infrastructure, with the IMF noting in April 2026 that agentic AI could shift payments from human-initiated instructions toward agent-mediated fi…

Nvidia Corp., Google LLC and startup Emerald AI Inc. launched the AI Energy Management Alliance (AEMA) on Wednesday to promote flexible data centers that cut power draw when the electrical grid is under strain. The conso…

Jina AI released jina-ocr-v1, a 3.4B-parameter document parser with roughly 570M active decoder parameters per token, scoring 91.14 on OmniDocBench v1.6 and 83.4 on olmOCR-Bench at 2.57 pages per second — the highest pag…

CoreWeave cofounder and CEO Mike Intrator said AI requires a cloud rebuilt from first principles rather than the cloud architecture designed for the internet era, arguing the current infrastructure was built to serve man…

A forum discussion of GPU pricing notes that used 8-channel memory CPUs such as AMD Epyc can deliver 110 GB/s to 128 GB/s of RAM bandwidth single-socket, with dual-socket Rome systems reported above 205 GB/s, while the C…