# The Lexical Imprint of Pre-training Data

> Source: <https://aiflash.com/news/141050/>
> Published: 2026-10-28 10:00:20+00:00

How much of zero-shot benchmark accuracy is captured by word-level alignment between a pre-training corpus and the benchmark target? We study this question through word-level unigram cross-entropy (UCE), a tokenizer-agnostic, model-free measure of lexical alignment between a reference corpus and a t