I built BrighTO-Router as a free open-source LLM gateway/router written in Rust.
The goal is simple: give a team one self-hosted API endpoint for AI traffic, while keeping the hot path small, fast, and understandable.
LLM gateways sit on the request path. The router should add as little latency and operational complexity as possible. Rust gives predictable memory use, fast async networking, and a deployment model that fits one Docker image.
The project publishes deterministic mock-backend benchmarks up to 1M-token payloads. These measurements report router overhead, not model inference speed, so the results are repeatable and honest.
Repo: [https://github.com/thusinh1969/BrighTO_Router](https://github.com/thusinh1969/BrighTO_Router)
Docs: [https://thusinh1969.github.io/BrighTO_Router/](https://thusinh1969.github.io/BrighTO_Router/)
Docker: thusinh1969/brighto_airouter:v1
source & further reading
dev.to — original article
My prompt-injection fix caught 0 of 20 attacks. The part I almost didn't build caught all of them.
It Looked Finished on Day One
The JSON-LD node that made a recall article look like a product