Toward Reliable Design of LLM-Enabled Agentic Workflows: Optimizing Latency-Reliability-Cost Tradeoffs
Researchers introduced performance models for LLM and non-LLM agents in agentic workflows, analyzing tradeoffs between latency, reliability, and cost. The study produced a water-filling token allocation policy and charac…