cd /news/artificial-intelligence/mira-math-a-benchmark-for-minimal-in… · home topics artificial-intelligence article
[ARTICLE · art-52031] src=arxiv.org ↗ pub= topic=artificial-intelligence verified=true sentiment=· neutral

MIRA-Math: A Benchmark for Minimal Information Requesting and Mathematical Reasoning

Researchers introduced MIRA-Math, a benchmark for evaluating mathematical reasoning where models must request a missing atomic fact under a strict budget before solving a problem. The benchmark contains 2,310 instances across 22 mathematical families and tests whether models can identify and request the needed information. Experiments show that request success and final answer accuracy are separable, highlighting distinct failure modes in reasoning systems.

read1 min views1 publishedJul 9, 2026

arXiv:2607.07391v1 Announce Type: new Abstract: Mathematical reasoning benchmarks typically provide all facts needed to solve each problem, while interactive benchmarks often mix reasoning with tools, retrieval, and long-horizon dialogue. We introduce MIRA-Math, a benchmark for a narrower diagnostic capability: solving mathematical problems whose full latent state has a unique answer, but whose solver-facing view is missing exactly one necessary atomic fact. The solver must request the missing information in natural language under a strict budget and then integrate the returned fact into an exact final answer. A fixed constrained LLM responder sees only the dataset-provided atomic fact and must either offer the quoted fact when the request matches it, or decline otherwise. Thus, instance generation, typed hint specifications, validation, and final-answer verification are deterministic, while request metrics are measured under a fixed LLM-mediated responder channel. MIRA-Math contains 2{,}310 generated instances from 22 typed mathematical families spanning algebra, probability, linear systems, discrete structures, signal processing, Markov chains, circuits, interpolation, and numerical boundary-value problems. Experiments across frontier and small models show that request success and final-answer accuracy are separable: models may ask for the right fact yet fail the downstream computation, or fail before obtaining the canonical hint. We release generators, verifiers, prompts, run metadata, and dataset documentation to support reproducible evaluation of minimal information requesting in mathematical reasoning.

── more in #artificial-intelligence 4 stories · sorted by recency
── more on @mira-math 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
Live at https://your-agent.zahid.host
Get free account → Pricing
from €0/mo · no card required
LIVE [news/mira-math-a-benchmar…] indexed:0 read:1min 2026-07-09 ·