Chutes

A one-year production trace from Chutes, a cloud platform, reveals how LLM serving workloads evolve over time and how user-model interactions shape traffic, according to a new arXiv paper (2608.13573v…

The self-hosted, OpenAI-compatible AI gateway llms.py released version 4 on July 20, 2026, adding projects, agent profiles, server tools, and publishing capabilities. The update supports 530+ models f…