OpenAI and Broadcom announce chip designed for LLM inference at scale
OpenAI and Broadcom announced a new chip called Jalapeño, designed specifically for large language model inference in data centers. The ASIC was developed from scratch based on insights from OpenAI researchers and promis…