{"slug": "synthetic-contrastive-reasoning-for-multi-table-q-a", "title": "Synthetic Contrastive Reasoning for Multi-Table Q&A", "summary": "Researchers have developed a synthetic contrastive reasoning-trace dataset for multi-table question answering (QA) by generating validated positive and plausible negative traces using heterogeneous large language models (LLMs). Fine-tuning open-weight LLMs with Contrastive Preference Optimization (CPO) on these preference pairs yielded absolute average improvements of 9.7% to 16.3% over standard QA supervised fine-tuning across Qwen3-14B, Mistral-8B, and Llama-3.1-8B, with gains up to 21 percentage points on the MMQA benchmark. The approach addresses the lack of reasoning supervision in existing multi-table QA resources, and evaluations confirm the generated traces are largely faithful, coherent, and meaningfully contrastive.", "body_md": "arXiv:2606.05382v1 Announce Type: new\nAbstract: Multi-table question answering requires models to retrieve relevant evidence, link schemas, and perform compositional reasoning across relational tables. Existing multi-table Q&A resources typically provide questions and final answers but lack reasoning supervision that explains how answers are derived. To address this gap, we construct a synthetic contrastive reasoning-trace dataset for MMQA by generating validated positive traces and plausible negative traces with heterogeneous LLMs. We then use the resulting preference pairs to fine-tune open-weight LLMs with Contrastive Preference Optimization (CPO). Across Qwen3-14B, Mistral-8B, and Llama-3.1-8B, CPO achieves absolute average improvements over Q&A supervised fine-tuning ranging from 9.7%-16.3%, with gains up to 21 percentage points on MMQA. Ablations show that heterogeneous positive and negative trace generators strengthen the contrastive signal, and automated as well as human evaluations indicate that the generated pairs are largely faithful, coherent, and meaningfully contrastive.", "url": "https://wpnews.pro/news/synthetic-contrastive-reasoning-for-multi-table-q-a", "canonical_source": "https://arxiv.org/abs/2606.05382", "published_at": "2026-06-06 04:00:00+00:00", "updated_at": "2026-06-06 04:17:21.715266+00:00", "lang": "en", "topics": ["large-language-models", "natural-language-processing", "machine-learning", "artificial-intelligence", "ai-research"], "entities": ["MMQA", "Qwen3-14B", "Mistral-8B", "Llama-3.1-8B", "Contrastive Preference Optimization", "CPO"], "alternates": {"html": "https://wpnews.pro/news/synthetic-contrastive-reasoning-for-multi-table-q-a", "markdown": "https://wpnews.pro/news/synthetic-contrastive-reasoning-for-multi-table-q-a.md", "text": "https://wpnews.pro/news/synthetic-contrastive-reasoning-for-multi-table-q-a.txt", "jsonld": "https://wpnews.pro/news/synthetic-contrastive-reasoning-for-multi-table-q-a.jsonld"}}