Language models are weird for the same reason human cultures are weird
Language models develop strange quirks, like OpenAI's GPT-5.1 becoming obsessed with referencing "goblins," due to a process called "chunky post-training" and overfitting. During training, the models …