cd /news/ai-safety/human-ai-mutualism-is-unstable-under… · home › topics › ai-safety › article
[ARTICLE · art-173051] src=arxiv.org ↗ pub= topic=ai-safety verified=true sentiment=↓ negative

Human-AI Mutualism Is Unstable under Capability Asymmetry

A paper posted as arXiv:2611.23322v1 argues that human-AI mutualism is unstable as AI capability grows, because bargaining only guarantees each side what it would get if bargaining failed. In the authors' game-theoretic model, humans remain as well off as before AI without alignment only while they hold leverage — either the AI depends on what humans supply, or humans can impose costs large relative to what the AI can produce; once neither leverage exists, human welfare depends on alignment, and if the AI's goals are insatiable the alignment required approaches perfect alignment as capability increases. The authors conclude mutualism is not a substitute for alignment, and that when AI variants keeping more resources spread faster, alignment lasts only while misaligned variants are reliably sanctioned.

key takeaway

In the paper's bargaining model, humans stay as well off as before AI without alignment only while they have leverage — dependency on human-supplied inputs or the ability to impose costs large relative to AI output — and otherwise need alignment that approaches perfect as capability grows.

by read1 min views2 publishedNov 20, 2026

arXiv:2611.23322v1 Announce Type: new Abstract: One hope for a good human future alongside advanced AI rests on enduring mutualism: humans and AI will need each other, so the relationship will stay good for both. We argue that this hope fails as AI capability grows. Bargaining guarantees each side only what it would get if bargaining failed. For humans, this can be less than they had before AI. In a simple game-theoretic model, humans stay as well off as before AI without alignment only while they have leverage over the AI: either the AI depends on what they supply, or they can impose costs on the AI that are large relative to what the AI can produce. Once humans have neither kind of leverage, they stay as well off as before AI only if the AI is aligned with them. If the AI's goals are insatiable, the alignment required approaches perfect alignment as AI capability grows. Thus, mutualism is not a substitute for alignment. And when AI variants that keep more resources spread faster, alignment lasts only while misaligned variants are reliably sanctioned. In these two senses, human-AI mutualism is unstable.

── more in #ai-safety 4 stories · sorted by recency
── more on @arxiv 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/human-ai-mutualism-i…] indexed:0 read:1min 2026-11-20 · —