cd /news/ai-safety/no-tokenizer-still-a-gap-cross-lingu… · home › topics › ai-safety › article
[ARTICLE · art-159251] src=arxiv.org ↗ pub= topic=ai-safety verified=true sentiment=↓ negative

No Tokenizer, Still a Gap: Cross-Lingual Fairness of Homoglyph and Invisible-Character Watermarking

Homoglyph and invisible-character watermarks still produce cross-lingual inequity even though they bypass tokenizers, according to an arXiv paper (2610.36432v1) measuring 40 language varieties across 24 scripts. The study found watermark capacity varies 3.3-fold, with script accounting for 96% of that variation; within Latin script resource level made no detectable difference (ρ=+0.095, p=0.78), but across scripts capacity rose with resource level (ρ=+0.54, 95% CI [+0.14,+0.83]) because lower-resourced languages tend to use scripts with few homoglyphs. After ordinary copy-paste strips invisible characters, a keyed detector needs about 2 code points of English or Persian text but 93 of Lao, leading the authors to conclude that removing the tokenizer does not remove the inequity, only changes its source.

by read1 min views3 publishedOct 28, 2026
arXiv:2610.36432v1 Announce Type: new 
Abstract: Homoglyph and invisible-character watermarks are edit-based watermarks. Instead of changing how a model generates text, they hide a signal in the text after it is written. They swap some characters for homoglyphs, which look the same, or very similar, but have different Unicode code points, or they insert characters that do not display, all without access to the model that wrote the text. Generation-time watermarks work less well for lower-resourced languages due to how tokenizers split their text. Because they work on individual characters, these watermarks never touch a tokenizer, so we ask whether they escape this gap. Across 40 language varieties in 24 scripts, we measure capacity (the hidden bits each character can carry), how much of it survives routine handling and targeted removal, and how much text a keyed detector needs. Capacity varies 3.3-fold and script accounts for 96\% of that variation. Within Latin script, resource level makes no detectable difference ($\rho=+0.095$, $p=0.78$), but across scripts capacity rises with it ($\rho=+0.54$, 95\% CI $[+0.14,+0.83]$), because lower-resourced languages tend to use scripts with few homoglyphs. Ordinary copy-paste, which strips invisible characters, widens the gap: a detector then needs about 2 code points of English or Persian but 93 of Lao. Removing the tokenizer does not remove the inequity, but instead only changes its source.
── more in #ai-safety 4 stories · sorted by recency
── more on @arxiv 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/no-tokenizer-still-a…] indexed:0 read:1min 2026-10-28 · —