chunk-lite: token-aware text chunking for RAG pipelines that doesn't cut mid-sentence
Developer Tejas released chunk-lite, an open-source JavaScript library for token-aware text chunking in RAG pipelines that respects sentence and paragraph boundaries to avoid cutting mid-thought. The …