cd /news/artificial-intelligence/routerec-strict-evaluation-of-recomm… · home topics artificial-intelligence article
[ARTICLE · art-58305] src=arxiv.org ↗ pub= topic=artificial-intelligence verified=true sentiment=· neutral

RouteRec: Strict Evaluation of Recommender-Agent Selection and Aggregation

Researchers introduced RouteRec, a framework for evaluating recommender-agent selection and aggregation under cost constraints, finding that item-level learned aggregation outperforms request-level hard selection on MovieLens-1M, with gated all-agent aggregation achieving HR@10 = 0.295 using 70.2% LLM calls, while hard selection remains below the BM25 baseline.

read1 min views1 publishedJul 14, 2026

arXiv:2607.09908v1 Announce Type: new Abstract: Recommender systems increasingly face a choice among heterogeneous agents -- collaborative filters, sequential models, content-based retrievers, and LLM-based rerankers -- yet no single agent is uniformly best. We study this choice as task-aware agent ranking under cost constraints using RouteRec, a framework that compares request-level hard selection with item-level learned aggregation over four traditional recommender agents and one LLM reranker agent. On MovieLens-1M, the full quality oracle has substantial headroom (HR@10 = 0.584), confirming that useful cross-agent signal exists. Under a leakage-free 5-fold out-of-fold protocol, however, hard selection remains below BM25 (0.223 vs. 0.254), and selective LLM escalation does not improve it. The same protocol yields a different outcome for learned aggregation: its cheap-only variant matches BM25 in HR and has a higher NDCG point estimate (0.123 vs. 0.114), while gated all-agent aggregation reaches HR@10 = 0.295 with 70.2% LLM calls. The resulting lesson is not that routing is solved, but that request-level selection of one complete agent list is too coarse for this sparse fixed-candidate setting; item-level aggregation is the more promising action space.

── more in #artificial-intelligence 4 stories · sorted by recency
── more on @routerec 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
Live at https://your-agent.zahid.host
Get free account → Pricing
from €0/mo · no card required
LIVE [news/routerec-strict-eval…] indexed:0 read:1min 2026-07-14 ·