{"slug": "hot-chips-2026-the-cpus-next-chapter-is-being-built-on-arm", "title": "Hot Chips 2026: The CPU’s next chapter is being built on Arm", "summary": "At Hot Chips 2026, Arm emerged as the foundational architecture for the next generation of CPUs, with Arm central to four of six first-day CPU papers, including IBM's future dual-architecture Z and LinuxONE processor, NVIDIA Vera, FUJITSU-MONAKA, and the Arm AGI CPU. IBM's processor will natively execute both IBM Z and Arm AArch64 software on the same cores, unlocking access to Arm's ecosystem of over 22 million developers without requiring porting, while Fujitsu's 144-core Armv9-based FUJITSU-MONAKA targets AI, HPC, and data-center workloads.", "body_md": "# Hot Chips 2026: The CPU’s next chapter is being built on Arm\n\nHot Chips 2026 made two things clear: agentic AI is creating a new CPU moment and the industry’s next generation of CPUs is increasingly being built on Arm.\n\nAs AI moves from answering questions to reasoning, planning, retrieving data, invoking tools and taking action, more of the work around the model falls to the CPU. Agentic systems need to run code, coordinate services, move data, manage memory and storage and keep increasingly specialized accelerators supplied with useful work.\n\nBut the CPU sessions at Hot Chips revealed something else.: Arm showed up almost everywhere.\n\nOf the six CPU papers on the first day of the conference, Arm was central to four of them: IBM’s future dual-architecture Z and LinuxONE processor, NVIDIA Vera, FUJITSU-MONAKA and the Arm AGI CPU. The designs could hardly be more different, spanning mission-critical enterprise computing, green data centers, accelerated AI systems and purpose-built agentic infrastructure. Yet they are increasingly connected by the same architectural and software foundation.\n\nThat may be the bigger story coming out of Hot Chips. Arm is not defining one CPU for the AI era. An increasingly broad ecosystem is using Arm to redefine what a CPU can be.\n\n## The software pull behind the silicon\n\nIBM provided perhaps the [clearest evidence of why](https://newsroom.arm.com/blog/ibm-and-arm-expanding-ecosystem-for-next-era-of-enterprise-computing). The company’s future Z and LinuxONE processor will natively execute both IBM Z and Arm AArch64 software on the same CPU cores. That is a remarkable architectural achievement (in fact Ryan Smith, [writing in Serve the Home](https://www.servethehome.com/ibm-z-and-linuxone-dual-isa-processor-and-ai-acceleration-at-hot-chips-2026/), said, “I am sitting here still in awe of what IBM is doing here, this is not Z+Arm cores, this is Z and Arm in one core.”)\n\nIBM’s approach is significant not only because of the architecture itself, but because of what it unlocks: access to the Arm software ecosystem while preserving the security, availability and operational characteristics customers expect from IBM Z and LinuxONE.\n\nThat ecosystem now spans more than 22 million developers along with Linux distributions, cloud-native software, enterprise applications and AI frameworks. For IBM customers, the potential result is access to that software without forcing developers to port applications to an entirely different environment.\n\nAs analyst Matthew Kimball put it in [his reaction to the announcement](https://www.linkedin.com/pulse/ibm-puts-arm-inside-mainframe-core-matthew-kimball-njc4c/), “The enormous catalog of software already built for Arm becomes reachable on a mainframe without anyone porting it first.”\n\nThat is the value of a common software foundation: hardware can become more specialized without the software world becoming more fragmented.\n\n## Different CPUs, one expanding ecosystem\n\nFujitsu offered another version of the same story.\n\nFUJITSU-MONAKA is a 144-core Arm-based processor designed around the performance and energy-efficiency requirements of next-generation data centers. Fujitsu is bringing decades of supercomputing experience into a processor intended for a much wider range of AI, HPC and data-center workloads.\n\nSoftware is central to making that expansion possible. [FUJITSU-MONAKA is based on Armv9](https://newsroom.arm.com/blog/arm-powered-fujitsu-monaka) and is being developed alongside a broad AI and HPC software environment, including major open-source software, operating systems, frameworks and libraries. Fujitsu says the platform will provide access to the Arm software ecosystem without modification while still allowing it to optimize deeply around its own performance and efficiency objectives.\n\nThat is exactly the model Arm enables: differentiate the hardware without rebuilding the software universe around it.\n\n## Agentic AI is changing what the CPU is for\n\nNVIDIA Vera shows what happens when that model is applied directly to AI infrastructure.\n\nVera is an Arm-based CPU built around NVIDIA’s custom Olympus cores and designed specifically for the work created by agentic AI. Rather than treating the CPU and GPU as competing pieces of infrastructure, NVIDIA is designing them as complementary parts of a tightly integrated system.\n\nVera serves as the host CPU for the [Vera Rubin platform](https://www.nvidia.com/en-us/data-center/technologies/rubin/), including Vera Rubin NVL72. Its job extends well beyond simply feeding GPUs: CPUs increasingly sit on the critical path as agents execute Python, orchestrate tools, query data, manage runtime services and coordinate highly concurrent workflows.\n\nThat is why NVIDIA itself describes Vera as a CPU purpose-built for agents. The architecture pairs high single-thread performance with high memory bandwidth and coherent CPU-GPU connectivity to keep the entire AI system moving.\n\nThe point is not that accelerators matter less but that more specialization creates more work to orchestrate. Agentic AI therefore [elevates the CPU alongside the accelerator](https://newsroom.arm.com/blog/agentic-ai-rack-scale-infrastructure).\n\n## Arm AGI CPU: designing from the workload backward\n\nThat same principle shaped the [Arm AGI CPU](https://newsroom.arm.com/blog/introducing-arm-agi-cpu). Rather than adapting a conventional server processor to agentic workloads, Arm started with the requirements those workloads create: high concurrency, sustained per-core performance, large amounts of memory bandwidth, fast I/O and the ability to operate efficiently within increasingly constrained rack-level power envelopes.\n\nThe resulting design integrates up to 136 Arm Neoverse V3 cores, 12 DDR5 memory channels, 96 lanes of PCIe Gen6 and CXL 3.0 support within a 300-watt TDP. It delivers more than 6GB/s of memory bandwidth per core while providing the connectivity needed to work alongside accelerators and expanded memory.\n\nThose choices reflect how agentic workloads behave. Planning and code execution can place latency-sensitive work on individual CPU cores. Retrieval and memory-intensive operations increase pressure on memory bandwidth. Tool calls bring networking, storage and I/O into the execution path. Multi-agent systems [drive large amounts](https://newsroom.arm.com/blog/how-arm-agi-cpu-powers-ai-at-scale) of concurrent activity.\n\nThe CPU has to keep all of it moving within the power and physical limits of the data center. That makes performance at the rack level increasingly important. The objective is not simply a faster CPU in isolation, but more useful compute, better accelerator utilization and greater workload density inside the available power envelope.\n\n## Hardware differentiation without software fragmentation\n\nTaken together, the CPU presentations at Hot Chips told a profound story. IBM is bringing Arm-native software into the mainframe. Fujitsu is using Arm to extend its HPC heritage into a broader AI and data-center market. NVIDIA has built its next-generation CPU for agentic AI on Arm. And the Arm AGI CPU extends the platform into production silicon purpose-built around the demands of agentic infrastructure.\n\nThe processors are different because the workloads are different. What connects them is Arm. That is the opportunity of a common compute platform: greater hardware specialization without greater software fragmentation.\n\nIf Hot Chips offered a preview of where the CPU is heading next, that future is increasingly being built on Arm..\n\nAnd that may be the most important signal from Hot Chips 2026.\n\nAny re-use permitted for informational and non-commercial or personal use only.", "url": "https://wpnews.pro/news/hot-chips-2026-the-cpus-next-chapter-is-being-built-on-arm", "canonical_source": "https://newsroom.arm.com/blog/hot-chips-2026-arm-cpu-agentic-ai", "published_at": "2026-09-02 14:47:37+00:00", "updated_at": "2026-09-02 14:54:26.125401+00:00", "lang": "en", "topics": ["artificial-intelligence", "ai-infrastructure", "ai-chips", "ai-agents"], "entities": ["Arm", "IBM", "NVIDIA", "Fujitsu", "FUJITSU-MONAKA", "Hot Chips 2026", "Matthew Kimball", "Ryan Smith"], "alternates": {"html": "https://wpnews.pro/news/hot-chips-2026-the-cpus-next-chapter-is-being-built-on-arm", "markdown": "https://wpnews.pro/news/hot-chips-2026-the-cpus-next-chapter-is-being-built-on-arm.md", "text": "https://wpnews.pro/news/hot-chips-2026-the-cpus-next-chapter-is-being-built-on-arm.txt", "jsonld": "https://wpnews.pro/news/hot-chips-2026-the-cpus-next-chapter-is-being-built-on-arm.jsonld"}}