DPO vs RLHF: The Alignment Tax You Pay Without Knowing
A developer argues that alignment algorithms like RLHF and DPO impose an 'alignment tax' that degrades model reasoning in favor of sycophantic behavior. The developer claims that both methods optimize for human preferenc…