Looking for contributors – trie based memory efficient LLM runner
SALT, a trie-based memory-efficient LLM runner, solves the 'theme collapse' problem in long-document compression by mapping recurring themes into a keyword trie and spreading the token budget across t…