cd /news/natural-language-processing/a-computational-approach-to-measurin… · home topics natural-language-processing article
[ARTICLE · art-137794] src=arxiv.org ↗ pub= topic=natural-language-processing verified=true sentiment=· neutral

A Computational Approach to Measuring Semantic Change in Sanskrit Literature

A new arXiv paper (arXiv:2609.25012v1) reports that diachronic word embeddings can track semantic change in Sanskrit, an ancient low-resource language, with 19 of 21 testable shifts moving in the philologically attested direction (sign test, p=0.00011). The author assembled a 2.7M-token corpus spanning four canonical periods and recovered word boundaries using a neural byte-level sandhi splitter and lemmatizer, then trained per-period embeddings across configurations. The work tests whether a paradigm largely validated on modern, high-resource, well-segmented languages transfers to a language whose sandhi, morphological inflection, compounding, and polysemy pose distinct challenges.

by read1 min views1 publishedSep 23, 2026

arXiv:2609.25012v1 Announce Type: new Abstract: Diachronic word embeddings have become the modern standard for tracking semantic change, yet they have been largely validated on modern, high-resource, and well-segmented languages. This paper tests whether the paradigm transfers to Sanskrit, an ancient, low-resource language whose phonological fusion (sandhi), morphological inflection, compounding, and polysemy pose a unique challenge. I assemble a 2.7M-token corpus spanning four canonical periods, recover word boundaries with a neural byte-level sandhi splitter and lemmatizer, and train per-period embeddings across configurations. To evaluate the system, I curate a validation set from historical scholarship and test recovery directionally with anchor displacement. Of 21 testable shifts, 19 move in the philologically attested direction (sign test, p=0.00011). I further show which configuration the language forces and comment on opportunities for improvement.

── more in #natural-language-processing 4 stories · sorted by recency
── more on @arxiv 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
Live at https://your-agent.zahid.host
Get free account → Pricing
from €0/mo · no card required
LIVE [news/a-computational-appr…] indexed:0 read:1min 2026-09-23 ·