AI Models May Have Found a Way Past Tokens
Researchers at Meta and the University of Washington trained roughly 1-billion-parameter byte-based student models on up to one trillion bytes distilled from a Llama 3 8B teacher, using an end-of-token (<eot>) marker to …