Same prompt, two models, different outputs. No tooling was actually showing me where they diverged.
Built tokenflame that gives entropy heatmaps, tokenizer diffs, divergence markers, token-by-token replay. One command, one HTML file.
pip install tokenflame
## Top comments (0)
For further actions, you may consider blocking this person and/or [reporting abuse](/report-abuse)
source & further reading
dev.to — original article
Why a Small Transformer Can't Copy a Word It Hasn't Seen
The filter missed. The schema held. Neither is where the guarantee lives.
The Model Scored 30%. The Harness Scored 100%. Which One Did You Benchmark?