Millwright: Self-Hosting Your Own LLM Router
Millwright, a Rust-based router for self-hosting LLM traffic, enables developers to manage model failovers and cost tracking without relying on third-party gateways. The tool supports Anthropic, Amazon Bedrock, and OpenA…