21:24
2026-07-20
github.com
artificial-intelligence
Free LLM balancer combines multiple local inference machines with cloud fallback
LLMrPro, a new self-hosted LLM router, pools users' own machines as inference workers with automatic per-tier cloud fallback, exposing a single OpenAI-compatible API. The open-source project, released…