Beyond the KV Cache: What Comes Next
A hardware analysis reveals that deploying 70-billion parameter models in FP16 requires moving 140 gigabytes of weights across the memory bus per token, creating a memory-bound bottleneck that limits …
A hardware analysis reveals that deploying 70-billion parameter models in FP16 requires moving 140 gigabytes of weights across the memory bus per token, creating a memory-bound bottleneck that limits …
AMD released GAIA 0.22, its latest local AI app update, with enhanced email capabilities including tracking pending emails, drafting replies that mimic the user's writing style, and scheduling email p…
OpenAI Head of Compute Infrastructure Sachin Katti predicts artificial intelligence will soon design the chips and systems it needs to run, as the company pushes into custom silicon to reduce reliance…
Wall Street ended lower on Thursday, with the tech-heavy Nasdaq Composite falling 1.5%, as AI-related stocks tumbled. TSMC dropped 2.3% despite a strong quarterly report, as its raised capex forecast …
A FreeBSD Foundation intern, Sourojeet Adhikari, is porting AMD's ROCm compute stack to FreeBSD, aiming to get at least simple vector addition working on the BSD platform. The project was highlighted …
Intel and Google Cloud expanded their strategic collaboration on July 16, 2026, with Intel deploying Google Cloud's Gemini Enterprise across its operations for agentic coding assistance and engineerin…
Big Tech earnings season begins July 22 with Google and Intel, as investors scrutinize AI spending and returns, with Microsoft and Meta facing pressure over heavy data center investments while Google …
AMD has appointed Alan Smith as its newest Corporate Fellow, recognizing his contributions to GPU architecture and technical leadership that advanced AMD AI computing. Mark Papermaster, AMD's executiv…
Veta, an AI agent that QA-tests Android apps using a swarm of autonomous sub-agents, runs 100% of its AI inference on AMD GPUs via Fireworks AI on AMD Instinct or self-hosted vLLM on ROCm. The system …
Taiwan Semiconductor Manufacturing Company (TSMC) reported record second-quarter net income of NT$706.6 billion ($22 billion), a 77.4% year-over-year increase, driven by surging AI chip demand. CEO C.…
ChatGPT recommended upgrading the GPU or CPU as the most cost-effective upgrades for a Socket AM4 system with an AMD Ryzen 7 5800X and RTX 3060 12GB, but the AI's suggestion to swap to a Ryzen 7 5700X…
Taiwan Semiconductor Manufacturing Company posted June 2026 revenue of NT$442.68 billion ($14 billion), a 68% year-over-year jump, and first-half revenue of NT$2.4 trillion ($75 billion), up 35.6%, dr…
The US Department of Commerce confirmed on March 3, 2025, that TSMC will invest $100 billion in Arizona, making it the largest foreign direct investment in American history. Combined with earlier comm…
Trellis2.c, a native executable for local 3D generation with Vulkan and CUDA backends, has been released on GitHub. The project aims to provide a lightweight alternative to Python/PyTorch runtimes, si…
AMD released an update to its Radeon Developer Tool Suite (RDTS) featuring Radeon GPU Profiler (RGP) 2.7, which now displays DirectX 12 HLSL shader source code alongside GPU instructions. The update a…
TSMC reported a 77% year-over-year net profit surge to NT$505.74 billion ($16 billion) in its latest quarter, driven by insatiable AI chip demand, marking its eighth consecutive quarter of profit grow…
Taiwan Semiconductor Manufacturing Company (TSMC) has identified artificial intelligence as a pivotal factor in rising demand for data center CPUs, with high-performance computing and AI now accountin…
Agentic inference is reshaping AI infrastructure, shifting the focus from training to inference and creating new storage bottlenecks, according to Greg Matson, senior vice president and head of market…
Taiwan Semiconductor Manufacturing Co. reported second-quarter revenue of about $39.6 billion, a record, with June alone bringing in NT$442.68 billion, as the company's numbers are seen as a verdict o…
AMD announced ROCm 7.14 as its new production release, marking a shift from the tech preview series that began with ROCm 7.9. The release adds official support for Ryzen AI 400 series processors, incl…