{"slug": "when-you-need-an-agent-gateway-not-just-another-llm-proxy", "title": "When you need an Agent Gateway, not just another LLM proxy", "summary": "NeuralTrust has built TrustGate, an open-source Agent Gateway in Go that provides a single control plane for both model calls and tool (MCP) calls, ensuring consistent identity, audit, budgets, and policy. The project positions itself as a complement to LLM proxies like LiteLLM, focusing on governance for agent tool traffic rather than provider breadth.", "body_md": "If your problem is \"one OpenAI-compatible endpoint for 50 providers,\" a proxy like **LiteLLM** is usually the right default. Huge catalog, huge community, good enough ops for most teams.\n\nIf your problem is \"agents that call tools (MCP) with the same identity, audit, budgets, and policy as model calls,\" a thinner **Agent Gateway** starts to matter — one control plane so auth doesn't drift between chat completions and tool traffic.\n\n| Need | Usually start with | Why |\n|---|---|---|\n| Broadest provider catalog, ecosystem glue | LiteLLM | Depth beats novelty |\n| Hosted control plane, zero ops | Portkey / Helicone-class | Ops off your plate |\n| Self-host, low overhead Go proxy | Bifrost / similar | Latency + governance focus |\nSelf-host LLM + MCP same policy/identity |\nAgent Gateway (e.g. TrustGate) | One plane for models + tools |\n| K8s/service-mesh native | Envoy AI Gateway / Kong | Fits existing mesh |\n\nIn practice the useful model is:\n\n`tools/list`\n\nis filtered per consumer`tools/call`\n\n, so spend and audit line up.That is the wedge: not \"another 100 providers,\" but one aggregation plane for models + tools.\n\nRepo: [https://github.com/NeuralTrust/TrustGate](https://github.com/NeuralTrust/TrustGate)\n\nBuilt in Go by NeuralTrust. Quickstart and \"Why TrustGate\" live in the README — including where it is *not* the right pick vs LiteLLM/Helicone/Portkey.\n\n*Disclosure: TrustGate / NeuralTrust DevRel.*", "url": "https://wpnews.pro/news/when-you-need-an-agent-gateway-not-just-another-llm-proxy", "canonical_source": "https://dev.to/victor_garca_a9d07ddc486/when-you-need-an-agent-gateway-not-just-another-llm-proxy-3nff", "published_at": "2026-08-23 04:11:23+00:00", "updated_at": "2026-08-23 04:43:20.102774+00:00", "lang": "en", "topics": ["ai-agents", "ai-infrastructure", "developer-tools", "ai-tools"], "entities": ["NeuralTrust", "TrustGate", "LiteLLM", "Portkey", "Helicone", "Bifrost", "Envoy AI Gateway", "Kong"], "alternates": {"html": "https://wpnews.pro/news/when-you-need-an-agent-gateway-not-just-another-llm-proxy", "markdown": "https://wpnews.pro/news/when-you-need-an-agent-gateway-not-just-another-llm-proxy.md", "text": "https://wpnews.pro/news/when-you-need-an-agent-gateway-not-just-another-llm-proxy.txt", "jsonld": "https://wpnews.pro/news/when-you-need-an-agent-gateway-not-just-another-llm-proxy.jsonld"}}