14:54
2026-07-14
discuss.huggingface.co
artificial-intelligence
DPO Training ruins my model’s conversational coherence
A developer reports that DPO training ruins the conversational coherence of a T5 model, causing it to output repetitive tokens like 'a a a a a a' or 'b b b b b b b' during inference. The issue emerges…