16:09
2026-10-15
dev.to
large-language-models
Evaluating DeepSeek models broke three assumptions my rubric was built on
A developer evaluating DeepSeek's R1 and V3 models found that a standard answer-only eval suite missed key failure modes of open-weight models, including correct reasoning traces paired with wrong fin…