AI models often pick the same answers, revealing a surprising conformity. Why do even the latest models stick to the same words?
AI models love 'serendipity'. Ask them to pick any word, and 41% of the time, they'll land on it. This isn't just a quirky factoid. It speaks volumes about AI's tendency towards conformity. When faced with the task of naming something as common as a tree, these models often unite around the same choices. But why?
Conformity Among the Machines #
A study involving 44 language models found a startling pattern. In seven out of 31 categories, more than 80% of answers were the same across models. These findings are part of what researchers are calling the 'One-Word Census'. It's a simple test, ask models to name something with many valid answers and see which they pick.
The reality is, these models are more conformist than most humans would be. In 18 out of 20 shared categories with people, AI showed a greater tendency to stick to the same answers. This isn't just a curiosity. It reveals a lot about the current state of AI development.
The Flagship Conundrum #
Interestingly, the most recent flagship models from lineages like Claude and GPT show a reversal in trends. While older models in these series became more conformist with time, the newest versions are bucking the trend. Is this an early sign of these models repositioning themselves at the top?
It seems that community and persona-tuned models are the real rebels here. They display the most divergence in their answers. So what's driving this conformity in the mainstream models? Perhaps it's a lack of creativity or a tendency to play it safe.
So What? #
Why should we care? Because it's a reminder that AI, like its makers, can fall into patterns of conformity. It raises questions about originality in AI outputs. Are we heading towards a future where AI creativity is just an illusion?
Show me a model that consistently surprises me, that's what I want to see. Until then, 'serendipity' remains a fitting choice. Another week, another AI wrapper with no real innovation.
Get AI news in your inbox
Daily digest of what matters in AI.