MultiPL-E

Ctok, an unofficial open-source library, reconstructs Anthropic's Claude tokenizer offline, reporting exact token counts for 1,664,940 v3 and 1,722,961 v4.7 texts with zero under-counts. The library s…

Researchers propose a three-phase pipeline to improve small language models for low-resource programming languages like Julia and Ballerina, achieving up to +14.2 points on pass@1 metrics while reduci…