Fortio

In benchmarks comparing proxy overhead, agentgateway 1.4.0 achieved 35,502 QPS with 0.863 ms P50 latency, while LiteLLM 1.98.0's Rust mode achieved 984 QPS with 32.139 ms P50 latency, making agentgate…

AgentGateway outperformed LiteLLM in a fixed-throughput benchmark at 3,000 QPS, sustaining 2,998.94 QPS with sub-millisecond P99 latency while LiteLLM achieved only 2,465.89 QPS with 30.6 ms P99 laten…

A benchmark comparing agentgateway and LiteLLM found agentgateway handled over 11× more requests per second (36,933 QPS vs 3,198 QPS) with sub-2 ms P99 latency while consuming under 30 MB of RAM, vers…