OpenAI and Broadcom unveil "Jalapeño," a custom chip built for LLM inference

OpenAI and Broadcom unveiled 'Jalapeño,' a custom chip designed for large language model inference, claiming better performance per watt. Development took nine months with OpenAI's models aiding the process. Large-scale deployment is planned for late 2026, with Microsoft expected to buy 40 percent of the chips.

OpenAI and Broadcom unveil "Jalapeño," a custom chip built for LLM inference Key Points - OpenAI and Broadcom have unveiled "Jalapeño," a custom chip built specifically for large language model inference. - OpenAI says the architecture delivers better performance per watt. Development took just nine months, with OpenAI's own models helping speed up the process. - Custom hardware is meant to make running AI models cheaper and more reliable. Large-scale deployment is planned for late 2026, with Microsoft expected to buy 40 percent of the chips. OpenAI is adding custom hardware to its tech stack. The "Jalapeño" chip, developed with Broadcom, is tailored for large language model inference and is set to run at scale by late 2026. According to a joint announcement https://openai.com/index/openai-broadcom-jalapeno-inference-chip/ , OpenAI and Broadcom have unveiled "Jalapeño" - OpenAI's first so-called "Intelligence Processor." It's a custom accelerator built specifically for large language model inference, and the first chip in a multi-generation platform the two companies are building together. Broadcom CEO Hock Tan and President Charlie Kawwas handed the first wafer to OpenAI CEO Sam Altman and President Greg Brockman. For OpenAI, this marks its first step into custom hardware after years of focusing on models and products. OpenAI says Jalapeño isn't a modified general-purpose chip. It was designed from scratch for modern LLM inference. OpenAI handles the chip design, Broadcom contributes silicon manufacturing and networking technology including its Tomahawk networking chips, and Celestica takes care of boards, racks, and system integration. Performance claims lack independent verification Early tests showed performance per watt that's "substantially better" than current state-of-the-art hardware, according to OpenAI. These are self-reported numbers that haven't been finalized. Take them with a grain of salt. A technical report is supposed to follow. Right now, it's unclear which chips Jalapeño was tested against, on what tasks, and under what conditions. The architecture reportedly cuts data movement and pushes utilization closer to its theoretical max. Engineering samples are already running ML workloads in the lab, including the GPT-5.3-Codex-Spark https://the-decoder.com/openai-has-yet-another-new-coding-model-and-this-time-its-really-fast/ model. That model currently runs on Cerebras https://the-decoder.com/cerebras-closes-1-billion-funding-round-at-23-billion-valuation-after-landing-openai-deal/ hardware, which also specializes in inference. OpenAI says the process from design to tape-out took just nine months, what the company calls the fastest ASIC development cycle for high-performance semiconductors it's aware of. OpenAI's own models helped speed up parts of the design process. The rumors about chip plans https://the-decoder.com/openai-considers-building-its-own-ai-chips-amid-chip-shortage-and-high-costs/ , though, have been circulating since 2023. The announcement reflects OpenAI's argument that controlling the full stack from chip to product lets it run models faster, more reliably, and at lower cost. Broadcom CEO Tan says the first deployment is planned for late 2026 at gigawatt scale, together with Microsoft and other partners. Broadcom has reportedly demanded that Microsoft https://the-decoder.com/broadcom-reportedly-wont-build-openais-custom-chip-unless-microsoft-buys-40-percent-of-them/ guarantee it will buy 40 percent of the chips to secure the first phase. AI News Without the Hype – Curated by Humans Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section. Subscribe now OpenAI https://openai.com/index/openai-broadcom-jalapeno-inference-chip/