{"type": "article", "title": "Sors: a Rust proxy that reorders prompts to maximize vLLM prefix cache hits", "publisher": "Web Pulse", "url": "https://wpnews.pro/news/sors-a-rust-proxy-that-reorders-prompts-to-maximize-vllm-prefix-cache-hits", "original_source": "https://github.com/flouthoc/sors", "published": "2026-06-16T17:15:31+00:00", "accessed": "2026-06-16", "id": "sors-a-rust-proxy-that-reorders-prompts-to-maximize-vllm-prefix-cache-hits"}