Tetrate Adds Ability to Route Inference Requests via AI Gateway
Tetrate added a token broker service to its AI gateway to route inference requests to the most suitable large language model based on capability and cost, and introduced a distributed inference control plane for usage po…