DeepSeek R1 670B

OpenAI has introduced Jalapeño, its first custom inference chip, developed with Broadcom and Celestica, to improve throughput, latency, and energy efficiency for serving large language models. The chi…

OpenAI said its Broadcom-built Jalapeño inference chip delivers 1.5 to 1.9 times more AI work per watt than Nvidia's GB200 and GB300 systems on tested models, with 1.7 to 3.6 times lower end-to-end la…