OpenAI (OPAI.PVT) president Greg Brockman believes the AI industry will continue to deal with computing capacity constraints for the foreseeable future.
"My prediction is very much that we will remain in this compute shortage no matter what," Brockman said during a roundtable discussion in New York City on Thursday.
"Right now we have to make hard decisions on what models we actually train, what products we actually scale," he explained at a roundtable event in New York City on Thursday.
AI labs like OpenAI and Anthropic (ANTH.PVT), and Big Tech companies ranging from Microsoft (MSFT) and Amazon (AMZN) to Meta (META) and others, are struggling to meet demand for their AI services as they juggle training new models and serving up software to customers.
That requires a massive amount of computing power from graphics chips like Nvidia's. And despite collectively spending hundreds of billions of dollars on data centers, the industry can't keep up.
During Google's (GOOG, GOOGL) Q2 earnings call on Wednesday, CFO Anat Ashkenazi said that, despite spending heavily on its own data centers, the company will also contract with third parties to access their computing capacity in Q3. Google signed a deal to rent out AI capacity from SpaceX (SPCX) for $920 million a month in June.
At times, Brockman said, he'll see how fast OpenAI is ramping capacity and think the company will have a surplus of compute, only for demand to increase further as OpenAI develops new models and new ways of using them.
"I think that that is going to be how it will feel because we are shifting to this compute-powered economy," Brockman explained.
The executive also said he believes customers are beginning to see a return on their investments in AI as they begin to use the software to improve their productivity, and dismissed the concept of workers and companies tokenmaxxing, or using as much AI computing as possible to simply show they're capable of doing so.
"I think people are starting to see that [return on investment] is there if you use [AI] right. If you just token max, then yeah, of course, you're just going to get max tokens. But if you value max, if you really try to apply these technologies to problems that matter, then you get the return," Brockman said.
Email Daniel Howley at dhowley@yahoofinance.com. Follow him on X at @DanielHowley.
Click here for the latest technology news that will impact the stock market**.**
Read the latest financial and business news from Yahoo Finance