API Gateway HTTP API + Lambda Function URLs: Building a Prompt‑Caching LLM Proxy, Explained Simply
A developer outlined a lightweight LLM proxy architecture that routes API Gateway HTTP APIs directly to Lambda Function URLs and adds a small in-process prompt cache, claiming sub-100 ms responses for…