04:00
2026-07-16
arxiv.org
large-language-models
Uncertainty-Aware Sequential Decision Rules for Event-Triggered LLM Invocation in Streaming Systems
Researchers formalize when to invoke large language models in streaming inference pipelines as a risk-based sequential stopping problem, proving optimality guarantees and sublinear regret bounds. On t…