{"slug": "2m-reasoning-examples-for-fine-tuning-small-models-with-worked-solutions-and-a", "title": "2M reasoning examples for fine-tuning small models, with worked solutions and a Python answer checker", "summary": "A dataset creator released CAEL Verified Reasoning on Hugging Face, a CC BY 4.0 collection of 2 million synthetic reasoning examples for fine-tuning small language models, spanning arithmetic, logic, multi-turn memory, conflicting reports and grid puzzles. The dataset splits into 1.98 million training examples, 20,000 test examples and a separate 1,427-example hard split, with roughly 37,000 examples covering missing information, contradictory premises or facts the user never supplied. The release includes the rule-based generator and a Python answer checker so users can create fresh examples and score model replies, leaving open whether fine-tuning still helps when someone else writes the questions.", "body_md": "I built CAEL Verified Reasoning for people training small language models. It has 2 million synthetic examples across eight areas, including arithmetic, logic, multi-turn memory, conflicting reports, and grid puzzles. The rule-based solvers behind CAEL generate each problem, calculate its reference answer, and write out the solution. The dataset is licensed under CC BY 4.0.\n\nOne question I wanted to explore was whether a model can tell when it has enough information to answer. Say I tell you my second bike ride took four minutes less than my first and ask how long the first ride took. You’d have to ask me for another detail. If I add that the second ride took 18 minutes, you can work out the answer. Around 37,000 examples deal with missing information, contradictory premises, or facts the user never supplied.\n\nThere are 1.98 million training examples, 20,000 test examples, and a separate hard split of 1,427. I’ve included the generator and a Python answer checker so you can make fresh examples and score model replies. The hard split uses the same generator, which leaves an open question I’d like to test: does fine-tuning still help when someone else writes the questions?\n\nYou can inspect a training example without downloading the whole dataset:\n\nfrom datasets import load_dataset\n\n``` python\nfrom datasets import load_dataset\n\nrows = load_dataset(\"vynly/cael-verified-reasoning\", split=\"train\", streaming=True)\nrow = next(iter(rows))\nprint(row[\"messages\"], row[\"answer\"], row[\"solution\"], sep=\"\\n\\n\")\n```\n\n[CAEL Verified Reasoning on Hugging Face](https://huggingface.co/datasets/vynly/cael-verified-reasoning)\n\nIf you try it with a small model, I’d love to know which one you used and see one question where a change in wording made it go from right to wrong. Those examples would help me decide what to add next.", "url": "https://wpnews.pro/news/2m-reasoning-examples-for-fine-tuning-small-models-with-worked-solutions-and-a", "canonical_source": "https://discuss.huggingface.co/t/2m-reasoning-examples-for-fine-tuning-small-models-with-worked-solutions-and-a-python-answer-checker/192328#post_1", "published_at": "2026-11-21 14:23:48+00:00", "updated_at": "2026-11-21 14:44:15.951608+00:00", "lang": "en", "topics": ["machine-learning", "large-language-models", "ai-research", "ai-tools"], "entities": ["CAEL Verified Reasoning", "Hugging Face", "vynly"], "also_reported_by": [], "takeaway": "CAEL Verified Reasoning offers 1.98 million training examples plus a 1,427-example hard split generated by the same rule-based solvers, letting builders test whether fine-tuning generalizes to questions written by someone else.", "recommendation": null, "alternates": {"html": "https://wpnews.pro/news/2m-reasoning-examples-for-fine-tuning-small-models-with-worked-solutions-and-a", "markdown": "https://wpnews.pro/news/2m-reasoning-examples-for-fine-tuning-small-models-with-worked-solutions-and-a.md", "text": "https://wpnews.pro/news/2m-reasoning-examples-for-fine-tuning-small-models-with-worked-solutions-and-a.txt", "jsonld": "https://wpnews.pro/news/2m-reasoning-examples-for-fine-tuning-small-models-with-worked-solutions-and-a.jsonld"}}