Apples to Apples? Towards Comparable Crosslingual Language Model Evaluation
A new arXiv preprint (2608.25089v1) finds that widely used normalized metrics for crosslingual language model evaluation introduce biases rooted in tokenization, encoding, and orthographic differences, while sentence-lev…