20:10
2026-08-15
github.com
artificial-intelligence
Ctok: Reconstructed Claude Tokenizer
Ctok, an unofficial open-source library, reconstructs Anthropic's Claude tokenizer offline, reporting exact token counts for 1,664,940 v3 and 1,722,961 v4.7 texts with zero under-counts. The library s…