17:40
2026-09-27
discuss.huggingface.co
large-language-models
Llama-modes: load one GGUF once, then Chat, Boolean, Choice and Scale
A developer released llama-modes, a fork of llama.cpp that loads one GGUF model once and reuses the same in-memory weights for Chat, Boolean, Choice and Scale inference modes without a second classifi…