OpenAI has just revealed a new “intelligence processor” chip for AI servers made in partnership with Broadcom. The chip, called Jalapeño, is designed to power current and future large language models, according to an announcement on Wednesday.
OpenAI’s first custom chip is made for the servers processing ChatGPT requests.
OpenAI’s first custom chip is made for the servers processing ChatGPT requests.
Jalapeño is an ASIC (Application-Specific Integrated Circuit), meaning it’s designed for a specific purpose: AI inference. With AI inference, models process a user’s request to run an agent like Codex or offer a response from ChatGPT, while AI training involves a model consuming vast amounts of data to inform its responses.
It comes just nine months after OpenAI revealed that it would team up with Broadcom to make its own chips, helping reduce the company’s reliance on the GPUs offered by Nvidia that are in limited supply. In an interview with Reuters, Broadcom CEO Hock Tan says it matches the performance of Nvidia’s Blackwell chips and Google’s Tensor processing units.
[Microsoft](/2023/11/15/23960345/microsoft-cpu-gpu-ai-chips-azure-maia-cobalt-specifications-cloud-infrastructure),
[Meta](/2024/4/10/24125924/meta-mtia-ai-chips-algorithm-training), and
Amazonare among the other AI companies that have also launched custom-designed AI chips recently to power their servers for either training or inference, while still trailing Nvidia’s chips on overall performance.
OpenAI calls Jalapeño the “first step in a multi-generation compute platform,” which it expects to deploy by the end of 2026. “While OpenAI is still measuring final performance, early testing shows that Jalapeño will deliver performance per watt substantially better than current state-of-the-art,” OpenAI says.
Follow topics and authors from this story to see more like this in your personalized homepage feed and to receive email updates.