Show HN: Suture – a reverse proxy that repairs truncated JSON in LLM streams
Suture, an ultra-low-latency reverse proxy, repairs truncated and malformed JSON in LLM streaming responses on the fly to prevent JSONDecodeError and similar parsing failures. The tool sits between applications and provi…