04:45
2026-07-21
github.com
large-language-models
Looking for contributors – trie based memory efficient LLM runner
SALT, a trie-based memory-efficient LLM runner, solves the 'theme collapse' problem in long-document compression by mapping recurring themes into a keyword trie and spreading the token budget across t…