13:31
2026-10-12
arxiv.org
large-language-models
Byte Language Models: Scaling, Emergent Abstractions, and Information Allocation
Byte Transformers trained with token-superposition training and hash embeddings consistently outperform subword Transformers as model size scales, according to an arXiv paper submitted on 5 October 20…