Optimal Model Activation Policies for Inference Networks of Large Language Models
A new arXiv paper (2609.15992v1) introduces "inference networks," a graph-based framework for routing queries among multiple expert large language models to minimize expected inference cost under a target performance con…