OpenAI Jalapeño Chip: What Cheaper Inference Means for Developers
OpenAI and Broadcom unveiled Jalapeño, OpenAI's first custom inference chip, on June 24, targeting 50% lower cost per token than Nvidia GPUs. The ASIC, built in nine months at TSMC's 3nm node, will not reach production u…