BrighTO-Router: an open-source Rust LLM gateway for fast, self-hosted AI traffic

A developer released BrighTO-Router, a free open-source LLM gateway and router written in Rust that provides teams with a single self-hosted API endpoint for AI traffic. The project publishes deterministic mock-backend benchmarks up to 1M-token payloads measuring router overhead rather than model inference speed, and ships as a single Docker image (thusinh1969/brighto_airouter:v1).

I built BrighTO-Router as a free open-source LLM gateway/router written in Rust. The goal is simple: give a team one self-hosted API endpoint for AI traffic, while keeping the hot path small, fast, and understandable. LLM gateways sit on the request path. The router should add as little latency and operational complexity as possible. Rust gives predictable memory use, fast async networking, and a deployment model that fits one Docker image. The project publishes deterministic mock-backend benchmarks up to 1M-token payloads. These measurements report router overhead, not model inference speed, so the results are repeatable and honest. Repo: https://github.com/thusinh1969/BrighTO Router https://github.com/thusinh1969/BrighTO Router Docs: https://thusinh1969.github.io/BrighTO Router/ https://thusinh1969.github.io/BrighTO Router/ Docker: thusinh1969/brighto airouter:v1