cd /news/large-language-models/a-model-of-diverse-sampling-from-lan… · home › topics › large-language-models › article
[ARTICLE · art-173022] src=arxiv.org ↗ pub= topic=large-language-models verified=true sentiment=↑ positive

A Model of Diverse Sampling from Language Models

A new arXiv paper (2611.25003v1) proposes PoolDPP, a method for drawing diverse sets of outputs from language models by sampling a size-K subset of complete strings from a determinantal point process, where likelihood encodes item quality and embedding geometry encodes repulsion between similar outputs. Because exact inference over all strings is intractable, PoolDPP draws a finite candidate pool from a tractable proposal, importance-weights candidates toward the target quality, and runs a K-DPP sampler on the induced pool kernel, with a greedy MAP variant for deterministic selection; the authors prove the KL divergence between the sampler's output and the target K-DPP decays as O(1/N) in pool size. Empirically, PoolDPP extends the quality-diversity frontier on open-ended generation and the precision-recall frontier on ambiguous text-to-SQL (Ambrosia), and on mathematical reasoning (GSM8K) it raises diversity at about the same pass@K.

recommendation

When generating K outputs, sample a finite candidate pool, importance-weight toward quality, and run a K-DPP sampler on the pool kernel to trade off quality and diversity; the source bounds divergence at O(1/N) in pool size.

more in playbook: Evals and testing for LLM apps
by read1 min views1 publishedNov 20, 2026

arXiv:2611.25003v1 Announce Type: cross Abstract: Language models often produce high-quality individual samples but poor sets, with repeated samples clustering around the same semantic modes. We formalize diverse generation as sampling a size-$K$ subset of complete strings from a determinantal point process (DPP), where the likelihood encodes item quality, and the embedding geometry encodes repulsion between similar outputs. Exact inference over all strings is intractable, so we propose PoolDPP: draw a finite candidate pool from a tractable proposal, importance-weight the candidates toward the target quality, and run a $K$-DPP sampler on the induced pool kernel; a greedy MAP variant provides deterministic selection. We prove a finite-sample bound with an explicit constant: the KL divergence between the sampler's output and the target $K$-DPP decays as O(1/N) in the pool size. Empirically, PoolDPP extends the quality--diversity frontier on open-ended generation and the precision--recall frontier on ambiguous text-to-SQL (Ambrosia), and on mathematical reasoning (GSM8K), it raises diversity at about the same pass@$K$.

── more in #large-language-models 4 stories · sorted by recency
── more on @pooldpp 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/a-model-of-diverse-s…] indexed:0 read:1min 2026-11-20 · —