arXiv:2610.06889v1 Announce Type: new Abstract: We study the application of large language models (LLMs) to the visual exploration of textual corpora. We introduce zero-shot visualization (ZSV), a task in which users specify concepts in natural language and documents are mapped onto the corresponding concept axes for visualization. Building a ZSV system of practical value is non-trivial, as it requires choices at the intersection of feature functions, efficient implementation tradeoffs, and pre/post-processing decisions affecting visualization quality. To that end, we establish a benchmark that compares methods spanning embedding similarity, direct semantic judgments, and conditional likelihood estimation in this setting. Across multiple datasets and use cases we evaluate the properties of different scoring methods and design choices in terms of semantic faithfulness, score fidelity, and computational cost. Our results identify that scoring based on next-token probabilities offers the strongest practical trade-off among the evaluated methods. We further apply this approach to unlabeled corpora to examine its behavior in realistic exploratory settings. These experiments highlight additional design considerations, including the use of graded axes together with binary relevance filtering, and reveal a compositional sentiment bias in off-topic documents. Based on these findings, we provide practical guidelines for constructing end-to-end ZSV baselines.
Zero-Shot Visualization: Exploring Text Corpora with User-Prompted Axes
A new arXiv paper (2610.06889v1) introduces zero-shot visualization (ZSV), a task in which users specify concepts in natural language and documents are mapped onto corresponding concept axes for visualization. The authors benchmark embedding similarity, direct semantic judgments, and conditional likelihood estimation across multiple datasets, finding that scoring based on next-token probabilities offers the strongest practical trade-off in semantic faithfulness, score fidelity, and computational cost. Experiments on unlabeled corpora also reveal a compositional sentiment bias in off-topic documents and support using graded axes with binary relevance filtering, yielding practical guidelines for end-to-end ZSV baselines.
Run your AI side-project on zahid.host
EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.