{"slug": "nvidia-and-coreweave-tackle-the-cpu-bottleneck-in-agentic-ai-infrastructure", "title": "Nvidia and CoreWeave tackle the CPU bottleneck in agentic AI infrastructure", "summary": "CoreWeave Inc. plans to offer standalone Nvidia Corp. Vera CPU capacity alongside its existing infrastructure, with CoreWeave senior director of product Harsh Banwait reporting about a 3x improvement in Sandbox startup times when tested with Vera CPUs. Nvidia director of product marketing Hannah Coutand said the CPU had become a bottleneck in the AI factory, driving the extreme co-design effort behind Vera, which handles tool calls, API calls and SQL queries while GPUs power model reasoning. Nvidia's Open Agent Safety Platform runs its OpenShell secure runtime on the Vera CPU and DOCA Sentry on BlueField-4 DPUs within a single Vera Rubin tray.", "body_md": "### Nvidia and CoreWeave tackle the CPU bottleneck in agentic AI infrastructure\n\nAgentic AI infrastructure must support the work between a model’s decisions as agents move from answering questions to executing tasks.\n\nCentral processing units handle much of that execution, while graphics processing units power model reasoning. Those complementary roles shape Nvidia Corp.’s planned Vera CPU deployment with CoreWeave Inc., according to [Hannah Coutand](https://www.linkedin.com/in/hannah-coutand) (pictured, right), director of product marketing, Vera CPU, at Nvidia.\n\n“The reason why Vera is so important is because we recognize that extreme co-design means that we look across the AI factory and we want to make sure we solve for any inefficient bottlenecks,” she said. “We recognized the CPU was becoming one of them. We didn’t set out to say, ‘Let’s go and build CPUs.’ We set out to solve this bottleneck.”\n\nCoutand and [Harsh Banwait](https://www.linkedin.com/in/hbanwait) (left), senior director of product at CoreWeave, spoke with theCUBE Research’s [Dave Vellante](https://www.linkedin.com/in/dvellante/) and [John Furrier](https://www.linkedin.com/in/furrier/) at the [Fully Connected event](https://www.thecube.net/events/coreweave/coreweave-fully-connected-2026), during an exclusive broadcast on theCUBE, SiliconANGLE Media’s livestreaming studio. They discussed CPU requirements, sandbox performance and infrastructure security. *(* Disclosure below.)*\n\n### Agentic AI infrastructure puts CPU performance under pressure\n\nAs [training and inference](https://siliconangle.com/2026/10/01/cognition-scales-ai-agent-infrastructure-coreweave-fullyconnected/) become increasingly intertwined, infrastructure must accommodate both model computation and the environments where agents act. Tool calls, application programming interface calls and SQL queries increase the execution work handled by CPUs, Coutand explained.\n\n“I think the volume certainly plays a role,” she said. “That’s why having a CPU that handles those types of calls extremely well, with fast, beefy cores, high memory bandwidth and low latency, it handles both operating in this new world … and serves as a great foundation for simply agentic use cases [and] reinforcement learning.”\n\nCoreWeave announced plans to [offer standalone Vera CPU capacity](https://www.coreweave.com/blog/nvidia-vera-cpu-is-coming-to-coreweave-pack-in-more-agents) alongside its existing infrastructure. Its [Sandboxes offering](https://www.coreweave.com/products/coreweave-sandboxes) provides isolated environments where agents can execute tasks during reinforcement learning and inference, Banwait explained.\n\n“Quite recently, we also tested that with Vera CPUs, and we were proud to share that we saw about a 3x improvement in performance in terms of Sandbox startup times,” he said. “For us, it’s a very important combination of getting the performance that we need from the silicon and getting our customers the experience that they expect from a product.”\n\n### Coordinating security and performance across the AI factory\n\nSecurity also shapes agentic AI infrastructure. Nvidia’s [Open Agent Safety Platform](https://www.nvidia.com/en-us/solutions/ai/agent-safety/) combines OpenShell runtime controls with Nvidia Sentry running on [BlueField-4 data processing units](https://www.nvidia.com/en-us/networking/products/data-processing-unit/) to provide an independent layer of monitoring and enforcement.\n\n“They’re all in a single Vera Rubin tray, which includes Vera CPU as well as the DPU; that’s all included in the same hardware infrastructure,” Coutand said. “So, Open Agent Safety Platform, the secure runtime, which is OpenShell, runs on the Vera CPU in that tray, and DOCA Sentry runs on the DPU part.”\n\nOperating that infrastructure requires attention to power, cooling and automation. Networking, CPUs and storage also figure in CoreWeave’s engineering priorities, Banwait explained.\n\n“All of that needs to be able to keep up,” he said. “We’re going to continue to focus on wherever the bottleneck is so that when the entire system is kind of advancing, it’s doing that in one cohesive way. Otherwise, the weakest link in the chain kind of holds it all back.”\n\nHere’s the complete video interview, part of SiliconANGLE’s and theCUBE’s coverage of the [Fully Connected event](https://www.thecube.net/events/coreweave/coreweave-fully-connected-2026):\n\n*(* Disclosure: TheCUBE is a paid media partner for the Fully Connected event. Neither CoreWeave, the sponsor of theCUBE’s coverage, nor other sponsors have editorial control over the content on theCUBE or SiliconANGLE.)*\n\n##### Photo: SiliconANGLE\n\n# A message from John Furrier, co-founder of SiliconANGLE:\n\nSupport our mission to keep content open and free by engaging with theCUBE community. **Join theCUBE’s Alumni Trust Network**, where technology leaders connect, share intelligence and create opportunities.\n\n- **15M+ viewers of theCUBE videos** , powering conversations across AI, cloud, cybersecurity and more\n- **11.4k+ theCUBE alumni** — Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network\n\n### Are you an AWS customer?  Support SiliconANGLE financially by buying your AWS services from our Marketplace portal page and links: [https://siliconangle.com/aws-marketplace/](https://siliconangle.com/aws-marketplace/)\n\n##### **About SiliconANGLE Media**\n\n[SiliconANGLE](https://cts.businesswire.com/ct/CT?id=smartlink&url=https%3A%2F%2Fsiliconangle.com%2F&esheet=54119777&newsitemid=20240910506833&lan=en-US&anchor=SiliconANGLE&index=9&md5=646b1b564e2259100a2b8638aab0a552),\n\n[theCUBE Network](https://cts.businesswire.com/ct/CT?id=smartlink&url=https%3A%2F%2Fwww.thecube.net%2F&esheet=54119777&newsitemid=20240910506833&lan=en-US&anchor=theCUBE+Network&index=10&md5=7de2a85f95ab4a4a495cede20b8cb1da),\n\n[theCUBE Research](https://cts.businesswire.com/ct/CT?id=smartlink&url=https%3A%2F%2Fthecuberesearch.com%2F&esheet=54119777&newsitemid=20240910506833&lan=en-US&anchor=theCUBE+Research&index=11&md5=7bb33676722925eb57d588ec343e4f6f),\n\n[CUBE365](https://cts.businesswire.com/ct/CT?id=smartlink&url=https%3A%2F%2Fwww.cube365.net%2F&esheet=54119777&newsitemid=20240910506833&lan=en-US&anchor=CUBE365&index=12&md5=d310fb35919714e66ad8d42c9c0c1bc6),\n\n[theCUBE AI](https://cts.businesswire.com/ct/CT?id=smartlink&url=https%3A%2F%2Fwww.thecubeai.com%2F&esheet=54119777&newsitemid=20240910506833&lan=en-US&anchor=theCUBE+AI&index=13&md5=b8b98472f8071b23ebb10ab9a8dd0683)and theCUBE SuperStudios — with flagship locations in Silicon Valley and the New York Stock Exchange — SiliconANGLE Media operates at the intersection of media, technology and AI.\n\nFounded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.", "url": "https://wpnews.pro/news/nvidia-and-coreweave-tackle-the-cpu-bottleneck-in-agentic-ai-infrastructure", "canonical_source": "https://siliconangle.com/2026/10/05/nvidia-coreweave-tackle-cpu-bottleneck-agentic-ai-infrastructure-fullyconnected/", "published_at": "2026-10-05 16:46:35+00:00", "updated_at": "2026-10-05 16:46:57.598737+00:00", "lang": "en", "topics": ["ai-infrastructure", "ai-agents", "ai-chips", "ai-safety"], "entities": ["Nvidia Corp.", "CoreWeave Inc.", "Vera CPU", "Hannah Coutand", "Harsh Banwait", "Open Agent Safety Platform", "BlueField-4", "Vera Rubin"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/nvidia-and-coreweave-tackle-the-cpu-bottleneck-in-agentic-ai-infrastructure", "markdown": "https://wpnews.pro/news/nvidia-and-coreweave-tackle-the-cpu-bottleneck-in-agentic-ai-infrastructure.md", "text": "https://wpnews.pro/news/nvidia-and-coreweave-tackle-the-cpu-bottleneck-in-agentic-ai-infrastructure.txt", "jsonld": "https://wpnews.pro/news/nvidia-and-coreweave-tackle-the-cpu-bottleneck-in-agentic-ai-infrastructure.jsonld"}}