# The novelty exposed: ablation, reproducibility and transparency in 40 technical reports of open-weight large language models (LLMs)

> Source: <https://aiflash.com/news/153974/>
> Published: 2026-11-18 20:09:07+00:00

**Recommendation:** Run ablations that isolate each claimed architectural change before calling a model new, and document the setup so others can reproduce the comparison.
More in the playbook "Evals and testing for LLM apps": <https://wpnews.pro/playbooks/evals-testing>

In 2025 alone, 48 new large language model (LLM) architectures were added to the Hugging Face transformers library, and many of them arrive with a technical report that presents the model as new. What is actually new in these models, and is it tested? We put this question to LLM technical reports. W
