Inference cloud operator General Compute raises $400M in debt financing

AI infrastructure startup General Compute secured $400 million in debt financing from Upper90 to expand its cloud platform, which uses AMD and SambaNova chips instead of Nvidia GPUs. The company plans to draw down additional funds as customer demand increases, targeting 15 megawatts of air-cooled rack capacity for its fourth-quarter growth.

Inference cloud operator General Compute raises $400M in debt financing Artificial intelligence infrastructure startup General Compute Inc. today announced that it secured $400 million in debt financing. Upper90, the investment firm that is underwriting the round, will initially provide the company with $100 million. General Compute plans to draw down additional funds as customer demand increases. Unlike most AI infrastructure providers, General Compute is not using Nvidia Corp. graphics cards. The company has based its cloud platform on chips from Advanced Micro Devices Inc. and SambaNova Inc., a fellow startup that recently raised https://siliconangle.com/2026/07/08/inference-chip-startup-sambanova-valued-11b-1b-funding-round/ $1 billion in funding. AI models answer user prompts through a two-step workflow. They start by extracting the meaning of a prompt, a step known as the prefill phase. They then generate a response one token at a time in a process known as decoding. The decoding phase requires AI models to move a significant amount of data between the host chip’s memory and processing circuits. SambaNova’s accelerators are specifically optimized to speed up that workflow. As a result, they can perform decoding faster than some Nvidia graphics cards. The speed at which data moves between a chip’s memory and processing modules depends on the physical distance between the circuits. The closer they are to each other, the less time it takes data to complete the trip. The memory and processing circuits in SambaNova’s chips are placed immediately next to one another, which minimizes data travel times. General Compute uses SambaNova silicon to run decoding calculations. It performs the other step involved in inference workflows, the prefill phase, using AMD’s MI300X graphics card. The chip contains 12 dies and 8 memory stacks that together contain 153 billion transistors. The MI300X and SambaNova’s chips are designed to run in standard air-cooled server racks. As a result, General Compute can add capacity to its cloud without investing in the pricey liquid cooling equipment that most graphics cards require. That translates into faster infrastructure upgrades. General Compute enables customers to access its inference hardware through two services. The first offers managed versions of open-source language models. Developers can access the models through an application programming interface modeled after the one used by OpenAI Group PBC, which eases the learning curve. General Compute’s second service provides dedicated infrastructure environments with more computing capacity. The company will use its debt financing to expand its cloud. According to a document https://www.generalcompute.com/whitepaper.pdf on its website, General Compute has inked agreements that give it the option to purchase 15 megawatts worth of air-cooled rack capacity in co-location facilities. The company expects that infrastructure to be sufficient for its fourth quarter growth plans. Photo: Unsplash https://unsplash.com/photos/blue-sky-with-white-clouds-xtgONQzGgOE A message from John Furrier, co-founder of SiliconANGLE: Support our mission to keep content open and free by engaging with theCUBE community. Join theCUBE’s Alumni Trust Network , where technology leaders connect, share intelligence and create opportunities. 15M+ viewers of theCUBE videos , powering conversations across AI, cloud, cybersecurity and more 11.4k+ theCUBE alumni — Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network. Are you AWS customer? Support SiliconANGLE Financially by buying your AWS services from our Marketplace portal page and links. About SiliconANGLE Media SiliconANGLE https://cts.businesswire.com/ct/CT?id=smartlink&url=https%3A%2F%2Fsiliconangle.com%2F&esheet=54119777&newsitemid=20240910506833&lan=en-US&anchor=SiliconANGLE&index=9&md5=646b1b564e2259100a2b8638aab0a552 , theCUBE Network https://cts.businesswire.com/ct/CT?id=smartlink&url=https%3A%2F%2Fwww.thecube.net%2F&esheet=54119777&newsitemid=20240910506833&lan=en-US&anchor=theCUBE+Network&index=10&md5=7de2a85f95ab4a4a495cede20b8cb1da , theCUBE Research https://cts.businesswire.com/ct/CT?id=smartlink&url=https%3A%2F%2Fthecuberesearch.com%2F&esheet=54119777&newsitemid=20240910506833&lan=en-US&anchor=theCUBE+Research&index=11&md5=7bb33676722925eb57d588ec343e4f6f , CUBE365 https://cts.businesswire.com/ct/CT?id=smartlink&url=https%3A%2F%2Fwww.cube365.net%2F&esheet=54119777&newsitemid=20240910506833&lan=en-US&anchor=CUBE365&index=12&md5=d310fb35919714e66ad8d42c9c0c1bc6 , theCUBE AI https://cts.businesswire.com/ct/CT?id=smartlink&url=https%3A%2F%2Fwww.thecubeai.com%2F&esheet=54119777&newsitemid=20240910506833&lan=en-US&anchor=theCUBE+AI&index=13&md5=b8b98472f8071b23ebb10ab9a8dd0683 and theCUBE SuperStudios — with flagship locations in Silicon Valley and the New York Stock Exchange — SiliconANGLE Media operates at the intersection of media, technology and AI. Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.