# 2M reasoning examples for fine-tuning small models, with worked solutions and a Python answer checker

> Source: <https://discuss.huggingface.co/t/2m-reasoning-examples-for-fine-tuning-small-models-with-worked-solutions-and-a-python-answer-checker/192328#post_1>
> Published: 2026-11-21 14:23:48+00:00

**Key takeaway:** CAEL Verified Reasoning offers 1.98 million training examples plus a 1,427-example hard split generated by the same rule-based solvers, letting builders test whether fine-tuning generalizes to questions written by someone else.

I built CAEL Verified Reasoning for people training small language models. It has 2 million synthetic examples across eight areas, including arithmetic, logic, multi-turn memory, conflicting reports, and grid puzzles. The rule-based solvers behind CAEL generate each problem, calculate its reference answer, and write out the solution. The dataset is licensed under CC BY 4.0.

One question I wanted to explore was whether a model can tell when it has enough information to answer. Say I tell you my second bike ride took four minutes less than my first and ask how long the first ride took. You’d have to ask me for another detail. If I add that the second ride took 18 minutes, you can work out the answer. Around 37,000 examples deal with missing information, contradictory premises, or facts the user never supplied.

There are 1.98 million training examples, 20,000 test examples, and a separate hard split of 1,427. I’ve included the generator and a Python answer checker so you can make fresh examples and score model replies. The hard split uses the same generator, which leaves an open question I’d like to test: does fine-tuning still help when someone else writes the questions?

You can inspect a training example without downloading the whole dataset:

from datasets import load_dataset

``` python
from datasets import load_dataset

rows = load_dataset("vynly/cael-verified-reasoning", split="train", streaming=True)
row = next(iter(rows))
print(row["messages"], row["answer"], row["solution"], sep="\n\n")
```

[CAEL Verified Reasoning on Hugging Face](https://huggingface.co/datasets/vynly/cael-verified-reasoning)

If you try it with a small model, I’d love to know which one you used and see one question where a change in wording made it go from right to wrong. Those examples would help me decide what to add next.
