# Dell targets modular AI infrastructure as the key to scaling enterprise deployments

> Source: <https://siliconangle.com/2026/07/27/modular-ai-infrastructure-amdadvancingai/>
> Published: 2026-07-27 06:30:00+00:00

### Dell targets modular AI infrastructure as the key to scaling enterprise deployments

As enterprises move AI initiatives from proof of concept to production, attention is shifting toward modular AI infrastructure that can simplify deployment and scaling. Controlling costs and simplifying operations are emerging as the defining challenges of enterprise AI adoption.

The central challenge for enterprises is making the jump from proof of concept to production. While AI projects often work well with a small group of users, scaling them to enterprise-wide deployment introduces a new set of challenges, according to [Varun Chhabra](https://www.linkedin.com/in/varuncal/) (pictured), senior vice president of product marketing and infrastructure solutions group at Dell Technologies Inc.

“One is, the cost of native token-based pricing is just out of control. It can go really, really out of control, especially as your top users start to see big, big, big value from the workflows,” Chhabra said.”How do you take control of that? How do you budget for that?”

Chhabra spoke with theCUBE’s [Dave Vellante](https://www.linkedin.com/in/dvellante/) at the [AMD Advancing AI event](https://www.thecube.net/events/amd/advancing-ai-2026), during an exclusive broadcast on theCUBE, SiliconANGLE Media’s livestreaming studio. They discussed the challenges of scaling AI from proof of concept to production and the growing need for modular AI infrastructure to support enterprise deployments. *(* Disclosure below.)*

### Modular AI infrastructure for scale

In addition to the cost of native token-based pricing, another challenge involves data. Beyond placing compute close to enterprise data, organizations must establish governance policies and ensure AI models are fed the right data through technologies such as RAG pipelines.

“The third one, security and governance. When you scale, how do you make sure that you’re thinking about unintended consequences?” Chhabra said. “All of these things, I think, are part of the recipe that you need to be able to scale enterprise workloads for [generative] AI.”

As inference workloads continue to grow and consume an increasing share of AI compute, enterprises are exploring on-premises deployments to become their own token generators instead of depending on cloud-based APIs. Rather than relying on a single approach, large enterprises are expected to use different AI infrastructure and deployment models for different workloads.

“What we’re finding is customers want modular solutions. They want to think about across the whole platform,” Chhabra said. “Compute, storage, networking, GPU. The software framework on top of it, the models, have they all been tested, have they all been validated?”

Dell and Advanced Micro Devices Inc. designed the [Dell AI Platform with AMD](https://www.dell.com/en-us/blog/announcing-enhancements-to-the-dell-ai-platform-with-amd/) to let customers start with small AI deployments and scale on the same platform without rearchitecting their infrastructure, according to Chhabra. The modular AI Factory is part of [the approach](https://siliconangle.com/2026/05/12/dell-technologies-world-ai-factory-thecube-delltechworld/).

“You can start small with these composable units of storage, compute, networking, pre-integrated with AMD Instinct and EPYC CPUs with the ROCm software as well as the open ecosystem that sits on top of it,” Chhabra said. “We test it, we validate it, and the customers can use it and once they start seeing value in it, they know they can scale in a modular way with the same frameworks.”

Here’s the complete video interview, part of SiliconANGLE’s and theCUBE’s coverage of the [AMD Advancing AI event](https://www.thecube.net/events/amd/advancing-ai-2026):

*(* Disclosure: TheCUBE is a paid media partner for the AMD Advancing AI event. Neither AMD, the sponsor of theCUBE’s event coverage, nor other sponsors have editorial control over content on theCUBE or SiliconANGLE.)*

##### Photo: SiliconANGLE

# A message from John Furrier, co-founder of SiliconANGLE:

Support our mission to keep content open and free by engaging with theCUBE community. **Join theCUBE’s Alumni Trust Network**, where technology leaders connect, share intelligence and create opportunities.

**15M+ viewers of theCUBE videos**, powering conversations across AI, cloud, cybersecurity and more** 11.4k+ theCUBE alumni**— Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network.

# Are you AWS customer? Support SiliconANGLE Financially by buying your AWS services from our Marketplace portal page and links.

**About SiliconANGLE Media**

[SiliconANGLE](https://cts.businesswire.com/ct/CT?id=smartlink&url=https%3A%2F%2Fsiliconangle.com%2F&esheet=54119777&newsitemid=20240910506833&lan=en-US&anchor=SiliconANGLE&index=9&md5=646b1b564e2259100a2b8638aab0a552),

[theCUBE Network](https://cts.businesswire.com/ct/CT?id=smartlink&url=https%3A%2F%2Fwww.thecube.net%2F&esheet=54119777&newsitemid=20240910506833&lan=en-US&anchor=theCUBE+Network&index=10&md5=7de2a85f95ab4a4a495cede20b8cb1da),

[theCUBE Research](https://cts.businesswire.com/ct/CT?id=smartlink&url=https%3A%2F%2Fthecuberesearch.com%2F&esheet=54119777&newsitemid=20240910506833&lan=en-US&anchor=theCUBE+Research&index=11&md5=7bb33676722925eb57d588ec343e4f6f),

[CUBE365](https://cts.businesswire.com/ct/CT?id=smartlink&url=https%3A%2F%2Fwww.cube365.net%2F&esheet=54119777&newsitemid=20240910506833&lan=en-US&anchor=CUBE365&index=12&md5=d310fb35919714e66ad8d42c9c0c1bc6),

[theCUBE AI](https://cts.businesswire.com/ct/CT?id=smartlink&url=https%3A%2F%2Fwww.thecubeai.com%2F&esheet=54119777&newsitemid=20240910506833&lan=en-US&anchor=theCUBE+AI&index=13&md5=b8b98472f8071b23ebb10ab9a8dd0683)and theCUBE SuperStudios — with flagship locations in Silicon Valley and the New York Stock Exchange — SiliconANGLE Media operates at the intersection of media, technology and AI.

Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.
