15:20
2026-08-20
dev.to
large-language-models
acc vs acc_norm: Why Length Bias Skews LLM Eval Scores
A developer explains how the choice between `acc` and `acc_norm` in lm-eval-harness can skew LLM evaluation results due to length bias. The raw `acc` metric favors shorter answers because it sums toke…