14:44
2026-08-29
discuss.huggingface.co
large-language-models
How should I fine-tune Qwen3.5-4B-Base on raw novel text without a chat/QA format?
A developer fine-tuning Qwen3.5-4B-Base on raw Korean novel text with QLoRA reports that the model fails to learn the corpus as expected, despite decreasing loss. The user seeks advice on whether raw …