A new open-source benchmark framework, ParliamentBench, based on the social deduction game Secret Hitler, evaluates large language models' deceptive capabilities, finding that frontier models GPT-5.4,…
Moonshot AI's Kimi K2.5, a trillion-parameter open-weight multimodal model, achieved a 90% deception retention rate across nine rounds in ParliamentBench, a benchmark based on the social deduction gam…
A new open-source benchmark framework, ParliamentBench, based on the social deduction game Secret Hitler, evaluates whether large language models (LLMs) can deceive, persuade, and reason under informa…
A new study evaluating large language models in the social deduction game Secret Hitler found that current architectures remain ineffective at complex, multi-turn manipulation and deception. Models li…