cd /news/large-language-models/gpt-6-1-sol-seems-to-do-worse-on-lon… · home › topics › large-language-models › article
[ARTICLE · art-169305] src=micjm.com ↗ pub= topic=large-language-models verified=true sentiment=↓ negative

GPT 6.1 Sol seems to do worse on long-tail languages.

A Hacker News commenter using the handle srcreigh reported that GPT 6.1 Sol repeatedly made basic mistakes on a Prolog project, as if the model did not grasp symbolic resolution, and then tagged the programming languages in all 712 GPT 6.1 Sol battles logged by the OpenCode agent-duel battle system using a tool called Jev to test whether the model performs worse outside common programming languages. The tagging drew on requests and available conversation context without showing Jev the outcomes, and the commenter presented the 712-battle dataset as the basis for examining long-tail language performance.

read1 min views2 publishedNov 13, 2026

srcreigh wrote in a Hacker News comment: The ideal language is the one the agent knows how to use.

I used prolog for a project and GPT 6.1 Sol repeatedly made dumb mistakes as if it doesn’t understand the symbolic resolution capabilities.

That made me curious: does Sol do worse when it’s working outside the usual programming languages?

We have some data to look at! We’re working on a battle system for OpenCode, which lets users compare models on their actual tasks. I used Jev to tag the programming languages in all 712 Sol battles, using the requests and available conversation context without showing it the outcomes.

source & further reading
micjm.com — original article Opus 5.5 is probably still nerfed Get ready for fewer Opus 5.5 em-dashes
── more in #large-language-models 4 stories · sorted by recency
── more on @gpt 6.1 sol 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/gpt-6-1-sol-seems-to…] indexed:0 read:1min 2026-11-13 · —