SpaCy

A developer released wardcat, an open-source Python library on PyPI that detects and reversibly masks sensitive data in RAG and LLM pipelines entirely on-premise, combining Regex, SpaCy NER, and local…

NLTK remains a viable tool for advanced text preprocessing despite the rise of LLMs. Three key tricks—MWETokenizer for preserving multi-word expressions, POS-aware lemmatization, and statistical collo…