As AI racks push past 100 kW, electrical engineering and resilience planning – not chip counts – are setting the cap.
For decades, each new generation of hardware has packed more compute into less space. AI accelerated that trend to a pace data centers have never seen before, as operators try to squeeze maximum performance from every rack in AI factory deployments. The change has been dramatic. Racks that seemed extreme two years ago now look ordinary, with the next jump already on the build sheet. The numbers tell the story. One common benchmark is “modal rack density,” the most frequently reported power draw per rack. In 2026, that figure reached 11 kW, up from 9 kW in 2025, according to Uptime Institute’s 16th Annual Global Data Center Survey. The 11 kW profile describes a typical enterprise server room – the kind you’d actually walk past in most data centers today – not an AI training cluster.
AI racks live in a different power class entirely. Nvidia’s GB300 NVL72 – central to AI training clusters through 2025 and early 2026 – requires up to 142 kW per rack, according to Nvidia’s NVL72 AI Factory reference architecture. Nvidia’s newest platform, Vera Rubin NVL72, entered full production in June 2026 and is slated to ship to cloud providers this fall. While Nvidia hasn’t published an official rack power figure, trade-press supply chain reports place it between 190 kW and 230 kW. Behind it, Nvidia’s Rubin Ultra NVL576 “Kyber” rack is already specified at roughly 600 kW in the second half of 2027.
So, what really caps density? Three questions define the ceiling: how much heat a rack can remove, how much power the chips draw, and how much power the facility can safely deliver.
The problem isn’t chip count, and it isn’t something bigger fans can fix. “The biggest misconception about what’s limiting density is that it’s capped by the number of GPUs per chassis, or that it’s a cooling issue that you solve with bigger fans,” Joseph Wolff, founder and CTO of eRacks Systems, told Data Center Knowledge.
Air Cooling Has Reached Its Limit, and Liquid Has Taken Over #
More compute means more heat, and for years, heat removal has set the hard limit on density. That limit keeps shifting as cooling technology improves.
Air Cooling Becomes Impractical
Air cooling becomes impractical above roughly 50 kW per rack, according to Uptime Institute. Past that point, fans just can’t move enough air to keep up with the thermal load.
Direct-to-Chip Is Now Standard
Liquid delivered through cold plates on the chip now handles 100 to 150 kW per rack and has become the dominant liquid method, holding 55% market share as of 2026, according to Schneider Electric.
Two-Phase Immersion Is Recovering, Not Dead
Once touted as the endgame, two-phase immersion was knocked back when PFAS restrictions choked off coolant supply. Adoption hasn’t fully recovered. A replacement fluid was qualified in early 2026, though the regulatory outcome won’t be resolved until 2027. “Microfluidics is the one I would still call ‘roadmap talk.’ The science is proven, but mainstream deployment is still a few years off,” said Omkar Nimbalkar, vice president, multi-vendor support services, at IBM, in an interview with Data Center Knowledge.
The Next Step Is Inside the Chip
In September 2025, Microsoft and Swiss startup Corintis reported lab tests showing that microchannels etched directly into a chip can remove heat up to three times more effectively than a standard cold plate.
Power Delivery, Not Cooling, Sets the Real Ceiling #
Thermal physics isn’t the only constraint. Power delivery is proving just as binding, and it’s not the chip specifications that ultimately decide the limit.
“People benchmark density against chip specs when, in practice, it’s bounded by electrical engineering and failure planning,” Nimbalkar said.
Legacy 54 VDC Hits the Copper Wall
Legacy 54 VDC power distribution runs into a hard limit above roughly 200 kW per rack, when the copper required to carry that current becomes too thick, heavy, and unwieldy to build.
Redundancy Imposes a Capacity Tax
A typical power distribution unit (PDU) handles about 20 kW, with a double-redundant configuration, while servers draw up to 6 kW each, Nimbalkar noted. “The design question is never how many GPUs you can buy, but how many you can safely run if a power supply fails,” he said.
The Power Feed, Not the Chip, Ultimately Sets the Limit
Chip vendors already design around these constraints, offering the same GPU at different power levels to fit within practical envelopes. “The real limit is the power and thermal budget per box, and it’s set by the GPUs themselves,” Wolff said. “Nvidia sells the same 96GB RTX PRO 6000 Blackwell as a 600 W part and as a 300 W Max-Q part – that second SKU exists because eight 600 W cards in one 4U is a 5 kW-class thermal problem most air-cooled rooms can’t feed or exhaust.”
Fixes Are Already Moving from Pilot to Standard #
Several efforts are underway to narrow the gap between what a rack demands and what a facility can deliver.
Higher-Voltage DC Distribution Is Moving Beyond Pilots
Vera Rubin NVL72 already ships with 800 VDC. The transition has moved beyond pilots: Vertiv, Schneider Electric, Eaton, and Delta all have commercial 800 VDC offerings slated for the second half of 2026, and Foxconn’s 40 MW Kaohsiung-1 facility in Taiwan is being built for it. But hardware availability isn’t the same as widespread adoption. “Ultimately, we’re asking organizations to digest a generation’s worth of change in 18-24 months,” Chris Butler, president of embedded and critical power at Flex, told Data Center Knowledge.
Power Delivery Is Being Disaggregated from Compute Racks
The Open Compute Project’s Mount Diablo project reached a finalized 0.7.0 specification in March 2026; Microsoft and Meta demonstrated working hardware built on it in July 2026. By separating power delivery from compute, facilities can scale power independently of the racks it feeds.
On-Site and Behind-the-Meter Generation Are Gaining Traction
More operators are building their own power capacity rather than waiting on utility timelines. Campus-level power “on paper” doesn’t guarantee you can deliver it reliably to a single rack.
“Once you start operating at those densities, power distribution and cooling really have to move together, so the number I pay more attention to isn’t necessarily how many megawatts a campus has on paper,” said Christopher Miglino, CEO of Axe Compute, in an interview with Data Center Knowledge. “It’s how much of that power you can actually deliver, cool, and operate reliably.”
Where the Ceiling Will Likely Sit Three to Five Years Out #
Heat removal, power delivery, failure risk, and cost each carry an open question over the next three to five years. Where those four land together will shape what “typical” looks like.
The Grid, Not the Rack, Will Be Decisive
Power availability will be decisive. As of the end of 2025, more than 2,060 GW of generation and storage were waiting in US interconnection queues, according to Lawrence Berkeley National Laboratory’s Queued Up report.
“On-site generation is a little more dependent on the project, but it’s becoming a much more serious part of the conversation for mega-scale AI campuses because, in many markets, the constraint isn’t demand or access to GPUs – it’s how quickly you can actually get enough power from the grid,” Miglino said.
As Racks Become Denser, Failures Become Costlier
As density climbs, a single failure knocks out more compute than it used to. That raises the bar for detection and graceful degradation. “The smarter approach is building in firmware-level failure detection that can throttle a rack down in seconds, which allows you to run denser than a conservative static number would normally allow,” Nimbalkar said.
By 2028, Typical High-Density Racks Will Likely Exceed 100 kW
The most likely default is 100 kW or more per rack. “A typical high-density AI rack in 2028 is probably a 100 kW-plus deployment with direct liquid cooling standard, 400 V power delivery, and failure-handling logic built into the firmware rather than added as an afterthought,” Nimbalkar said.
Miglino expects the same threshold, with the leading edge well beyond it.
Wolff, however, expects a bifurcation: most enterprises will stay air-cooled, while a smaller set of headline racks will charge far past 100 kW. “The typical high-density AI rack – what most enterprises will actually deploy – is air-cooled 4U nodes with eight GPUs each at 300 W-class power, about 4 kW per box, three or four boxes per rack on ordinary 208 V feeds,” Wolff said.