13:13
2026-07-08
discuss.huggingface.co
large-language-models
Setup: Ollama serving llama3.1:8b-instruct-q4_K_M, chat completions API (/api/chat), num_ctx=4096, temperature 0.2-0.3
A developer reports three production issues with Ollama serving llama3.1:8b-instruct-q4_K_M for multi-turn conversations in Spanish, including the model treating a second system message as a response …