{"slug": "tabrank-chain-of-thought-distillation-for-table-re-rankers", "title": "TabRank: Chain-of-Thought Distillation for Table Re-Rankers", "summary": "TabRank, a framework for training reasoning rerankers for tabular retrieval, improves Acc@10 by 30.5% on HybridQA, 15.2% on SQA, 52.9% on TabFact, and 13.1% on TATQA compared to the base model, according to a new arXiv paper. The approach uses chain-of-thought distillation from large reasoning models to train compact student rerankers on a dataset of 6,728 reasoning traces, and generalizes effectively to multi-table reasoning.", "body_md": "arXiv:2607.25182v1 Announce Type: new\nAbstract: The ability to retrieve relevant tables for answering questions is a key task for structured information retrieval. Multi-stage retrieval systems rely heavily on rerankers to refine candidate lists produced by efficient first-stage retrievers. As a result, neural rerankers and LLM-based reranking methods have become increasingly important due to their superior capacity for semantic understanding and reasoning compared to conventional sparse or dense retrieval models. Recently, Large Reasoning Models (LRMs) equipped with explicit chain-of-thought (CoT) reasoning have shown strong improvements in ranking quality in unstructured passage retrieval. In this work, we present TabRank, a framework for training reasoning rerankers for Tabular Retrieval. We first present a comprehensive dataset of 6728 reasoning traces for tabular reranking on the Natural Questions Tables dataset. We then explore two variants of training a compact reasoning model on these reasoning traces: explicit CoT distillation and conditioning the student reranker on the teacher's reasoning trace within the prompt. We stress-test TabRank on several out-of-distribution generalization settings on diverse domains and multi-table scenarios. Our approach significantly improves performance across a variety of table retrieval datasets, increasing Acc@10 by 30.5% on HybridQA, 15.2% on SQA, 52.9% on TabFact, and 13.1% on TATQA subsets of the Multi-Table QA Benchmark compared to the base model. Notably, TabRank generalizes effectively to multi-table reasoning. Our code, data and models are available at https://github.com/AdarshSingh7647/TabRanker", "url": "https://wpnews.pro/news/tabrank-chain-of-thought-distillation-for-table-re-rankers", "canonical_source": "https://arxiv.org/abs/2607.25182", "published_at": "2026-07-29 04:00:00+00:00", "updated_at": "2026-07-29 04:26:44.989543+00:00", "lang": "en", "topics": ["artificial-intelligence", "machine-learning", "natural-language-processing", "ai-research"], "entities": ["TabRank", "arXiv", "Natural Questions Tables", "HybridQA", "SQA", "TabFact", "TATQA", "Multi-Table QA Benchmark"], "alternates": {"html": "https://wpnews.pro/news/tabrank-chain-of-thought-distillation-for-table-re-rankers", "markdown": "https://wpnews.pro/news/tabrank-chain-of-thought-distillation-for-table-re-rankers.md", "text": "https://wpnews.pro/news/tabrank-chain-of-thought-distillation-for-table-re-rankers.txt", "jsonld": "https://wpnews.pro/news/tabrank-chain-of-thought-distillation-for-table-re-rankers.jsonld"}}