OpenAI's Jalapeño Chip Is a Bet on Inference Economics
OpenAI has taped out its first custom inference chip, named Jalapeño, built with Broadcom. The ASIC is designed to reduce inference costs for serving LLMs, following the vertical-integration strategy of Google and Amazon…