{"slug": "ai-inference-servers-shrink-to-fit-the-air-cooled-racks-enterprises-already-run", "title": "AI inference servers shrink to fit the air-cooled racks enterprises already run", "summary": "Axelera AI B.V. unveiled Titania, a third-generation inference architecture that scales to a 400-watt chip and a six-kilowatt server designed to fit existing 20- to 30-kilowatt air-cooled enterprise racks, vice president and head of product Manuel Botija said at SC26. Axelera's Europa chip has shipped since September, and the company positions the power-efficient design, built on digital in-memory computing, against GPU racks that cost at least $1 million and typically require liquid cooling. \"Enterprises cannot own their own infrastructure. They're locked out because of the cost and the power,\" Botija said, arguing the hardware lets companies amortize their own AI infrastructure instead of renting cloud compute.", "body_md": "### AI inference servers shrink to fit the air-cooled racks enterprises already run\n\nPower-efficient inference chips are becoming the entry price for enterprises that want to run AI on hardware they own.\n\nAs AI shifts from building models to running them every day, costly graphics processing unit racks and the liquid cooling they demand keep many companies renting compute instead. That gap is opening room for challengers to the incumbent chipmakers. Axelera AI B.V. built its business at the edge with low-power chips and [edge AI development tools](https://siliconangle.com/2026/07/15/chipmaker-axelera-releases-voyager-wingman-speed-edge-ai-development/), and it is now taking that technology into data center infrastructure, according to [Manuel Botija](https://www.linkedin.com/in/manubotija/) (pictured), vice president and head of product at Axelera.\n\n“Enterprises cannot own their own infrastructure. They’re locked out because of the cost and the power,” Botija said. “We are enabling them now to own it. It’s not that we are helping the world save power or save money — which we are — but it’s that we are unlocking use cases that were simply not possible before.”\n\nBotija spoke with theCUBE Research’s [John Furrier](https://www.linkedin.com/in/furrier/) and [Rebecca Knight](https://www.linkedin.com/in/rebecca-m-knight-3667a94/) at [SC26](https://www.thecube.net/events/acm-ieee/sc26), during an exclusive broadcast on theCUBE, SiliconANGLE Media’s livestreaming studio. They discussed how power-efficient inference chips are heading for the data center and how enterprises locked out by the cost and power of GPU racks can own their own AI infrastructure instead of renting compute. *(* Disclosure below.)*\n\n### Power-efficient inference chips head for the data center\n\nAxelera’s Europa chip has been shipping since September. Ahead of SC26, the company [unveiled Titania](https://axelera.ai/news/axelera-ai-unveils-titania-architecture-hpc-class-ai-responsiveness-without-liquid-cooled-racks-targeting-110b-underserved-market), a third-generation architecture that scales the design up to a 400-watt chip. The resulting six-kilowatt server is built to perform like leading data center GPUs while fitting into the existing 20- to 30-kilowatt air-cooled racks of an ordinary enterprise data center, Botija explained.\n\n“Having a six-kilowatt server that can perform like a data centre DPU is a pretty big deal,” he said. “It basically means that they have some storage equipment, some networking equipment, some traditional CPU equipment, and next to all of that, they can also insert some AI inference hardware acceleration without needing to go and rebuild another server room or another data center.”\n\nFor enterprises that would rather own their AI hardware than pay a recurring cloud bill, the barriers have been steep. A GPU rack costs at least $1 million, often far more, and usually requires liquid cooling, Botija noted. Axelera’s answer rests on digital in-memory computing, a technique that grew out of its founders’ research and gives the company’s power-efficient inference chips a performance-per-watt advantage.\n\n“Now you can own your own infrastructure,” Botija said. “You can amortize those investments and … reduce your OPEX, and therefore be more profitable as a company.”\n\nStay tuned for the complete video interview, part of SiliconANGLE’s and theCUBE’s coverage of [SC26](https://www.thecube.net/events/acm-ieee/sc26).\n\n*(* Disclosure: NYSE Wired sponsored this segment of theCUBE. Neither NYSE Wired nor other sponsors have editorial control over content on theCUBE or SiliconANGLE.)*\n\n##### Photo: SiliconANGLE\n\n# A message from John Furrier, co-founder of SiliconANGLE:\n\nSupport our mission to keep content open and free by engaging with theCUBE community. **Join theCUBE’s Alumni Trust Network**, where technology leaders connect, share intelligence and create opportunities.\n\n- **15M+ viewers of theCUBE videos** , powering conversations across AI, cloud, cybersecurity and more\n- **11.4k+ theCUBE alumni** — Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network\n\n### Are you an AWS customer?  Support SiliconANGLE financially by buying your AWS services from our Marketplace portal page and links: [https://siliconangle.com/aws-marketplace/](https://siliconangle.com/aws-marketplace/)\n\n##### **About SiliconANGLE Media**\n\n[SiliconANGLE](https://cts.businesswire.com/ct/CT?id=smartlink&url=https%3A%2F%2Fsiliconangle.com%2F&esheet=54119777&newsitemid=20240910506833&lan=en-US&anchor=SiliconANGLE&index=9&md5=646b1b564e2259100a2b8638aab0a552),\n\n[theCUBE Network](https://cts.businesswire.com/ct/CT?id=smartlink&url=https%3A%2F%2Fwww.thecube.net%2F&esheet=54119777&newsitemid=20240910506833&lan=en-US&anchor=theCUBE+Network&index=10&md5=7de2a85f95ab4a4a495cede20b8cb1da),\n\n[theCUBE Research](https://cts.businesswire.com/ct/CT?id=smartlink&url=https%3A%2F%2Fthecuberesearch.com%2F&esheet=54119777&newsitemid=20240910506833&lan=en-US&anchor=theCUBE+Research&index=11&md5=7bb33676722925eb57d588ec343e4f6f),\n\n[CUBE365](https://cts.businesswire.com/ct/CT?id=smartlink&url=https%3A%2F%2Fwww.cube365.net%2F&esheet=54119777&newsitemid=20240910506833&lan=en-US&anchor=CUBE365&index=12&md5=d310fb35919714e66ad8d42c9c0c1bc6),\n\n[theCUBE AI](https://cts.businesswire.com/ct/CT?id=smartlink&url=https%3A%2F%2Fwww.thecubeai.com%2F&esheet=54119777&newsitemid=20240910506833&lan=en-US&anchor=theCUBE+AI&index=13&md5=b8b98472f8071b23ebb10ab9a8dd0683)and theCUBE SuperStudios — with flagship locations in Silicon Valley and the New York Stock Exchange — SiliconANGLE Media operates at the intersection of media, technology and AI.\n\nFounded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.", "url": "https://wpnews.pro/news/ai-inference-servers-shrink-to-fit-the-air-cooled-racks-enterprises-already-run", "canonical_source": "https://siliconangle.com/2026/11/19/power-efficient-inference-chips-let-enterprises-own-ai-hardware-sc26/", "published_at": "2026-11-19 19:29:20+00:00", "updated_at": "2026-11-19 19:44:40.385571+00:00", "lang": "en", "topics": ["ai-infrastructure", "ai-chips", "ai-products"], "entities": ["Axelera AI B.V.", "Manuel Botija", "Titania", "Europa", "SC26", "theCUBE", "SiliconANGLE", "John Furrier"], "also_reported_by": [], "takeaway": "Axelera's Titania architecture puts a 400-watt inference chip into a six-kilowatt server that fits 20- to 30-kilowatt air-cooled racks, avoiding the liquid cooling and $1 million-plus cost of GPU racks.", "recommendation": null, "alternates": {"html": "https://wpnews.pro/news/ai-inference-servers-shrink-to-fit-the-air-cooled-racks-enterprises-already-run", "markdown": "https://wpnews.pro/news/ai-inference-servers-shrink-to-fit-the-air-cooled-racks-enterprises-already-run.md", "text": "https://wpnews.pro/news/ai-inference-servers-shrink-to-fit-the-air-cooled-racks-enterprises-already-run.txt", "jsonld": "https://wpnews.pro/news/ai-inference-servers-shrink-to-fit-the-air-cooled-racks-enterprises-already-run.jsonld"}}