A private enterprise AI gateway

TokenHub, a private enterprise AI gateway developed by Asta Xie, provides role-based workspaces for users, team leaders, and administrators, separating model usage, team governance, and platform administration. The gateway supports OpenAI-compatible APIs, multiple provider channels including Azure OpenAI, Anthropic, and DeepSeek, and offers features such as project-scoped API keys, usage analytics, and OAuth/OIDC enterprise sign-in, with deployment via Docker Compose and an Apache 2.0 license.

TokenHub is a private enterprise AI gateway with role-based workspaces for users, team leaders, and administrators. | Login Console | Gateway Overview | |---|---| | API Documentation | Provider Channels | | Model Catalog | Routing Policies | | Usage Analytics | System Settings | TokenHub separates everyday model usage, team governance, and platform administration so enterprise users see the workflows that match their responsibility. | Role | Workspace Focus | Guide | |---|---|---| | User | Find available models, create project-scoped API keys, call the model API, and review personal usage | | Team Leader Guide /astaxie/TokenHub/blob/main/docs/team-leader-guide.md Administrator Guide /astaxie/TokenHub/blob/main/docs/administrator-guide.md - OpenAI-compatible model APIs: /v1/chat/completions , /v1/responses , /v1/embeddings . - Provider channels for OpenAI-compatible, Azure OpenAI, Anthropic, Gemini, DeepSeek, Qwen, local vLLM/Ollama, and custom upstreams. - Model catalog and routing policies with priority, weight, failover order, and route health diagnostics. - Project-scoped key management with team ownership, member permissions, quotas, and concurrency controls. - Usage analytics and request logs attributed to user, project, team, model, and cost center. - Identity source configuration for OAuth/OIDC enterprise sign-in, plus RBAC and audit trails. - Clean console with compact role-aware navigation, global search, light/dark mode, and split-view API documentation. - SQLite-first private deployment with Docker Compose support. - Console language switching for English, Chinese, and Japanese. cp deploy/.env.example deploy/.env docker compose --env-file deploy/.env -f deploy/docker-compose.yml up -d --build Open: - Admin console: http://localhost:3000 - Backend API: http://localhost:8080 - Health check: http://localhost:8080/healthz Default admin login: - Username: admin - Password: admin123456 Change the default password and secrets in deploy/.env before exposing TokenHub beyond a local machine. Backend: cd backend go run ./cmd/tokenhub Frontend: cd frontend npm install npm run dev Smoke-test the model API with the included SDK example: cd sdk npm install npm run test:deepseek TokenHub is licensed under the Apache License 2.0 /astaxie/TokenHub/blob/main/LICENSE .