{"slug": "human-ai-mutualism-is-unstable-under-capability-asymmetry", "title": "Human-AI Mutualism Is Unstable under Capability Asymmetry", "summary": "A paper posted as arXiv:2611.23322v1 argues that human-AI mutualism is unstable as AI capability grows, because bargaining only guarantees each side what it would get if bargaining failed. In the authors' game-theoretic model, humans remain as well off as before AI without alignment only while they hold leverage — either the AI depends on what humans supply, or humans can impose costs large relative to what the AI can produce; once neither leverage exists, human welfare depends on alignment, and if the AI's goals are insatiable the alignment required approaches perfect alignment as capability increases. The authors conclude mutualism is not a substitute for alignment, and that when AI variants keeping more resources spread faster, alignment lasts only while misaligned variants are reliably sanctioned.", "body_md": "arXiv:2611.23322v1 Announce Type: new \nAbstract: One hope for a good human future alongside advanced AI rests on enduring mutualism: humans and AI will need each other, so the relationship will stay good for both. We argue that this hope fails as AI capability grows. Bargaining guarantees each side only what it would get if bargaining failed. For humans, this can be less than they had before AI. In a simple game-theoretic model, humans stay as well off as before AI without alignment only while they have leverage over the AI: either the AI depends on what they supply, or they can impose costs on the AI that are large relative to what the AI can produce. Once humans have neither kind of leverage, they stay as well off as before AI only if the AI is aligned with them. If the AI's goals are insatiable, the alignment required approaches perfect alignment as AI capability grows. Thus, mutualism is not a substitute for alignment. And when AI variants that keep more resources spread faster, alignment lasts only while misaligned variants are reliably sanctioned. In these two senses, human-AI mutualism is unstable.", "url": "https://wpnews.pro/news/human-ai-mutualism-is-unstable-under-capability-asymmetry", "canonical_source": "https://arxiv.org/abs/2611.23322", "published_at": "2026-11-20 05:00:00+00:00", "updated_at": "2026-11-20 05:15:43.122489+00:00", "lang": "en", "topics": ["ai-safety", "ai-research", "artificial-intelligence"], "entities": ["arXiv", "arXiv:2611.23322v1"], "also_reported_by": [], "takeaway": "In the paper's bargaining model, humans stay as well off as before AI without alignment only while they have leverage — dependency on human-supplied inputs or the ability to impose costs large relative to AI output — and otherwise need alignment that approaches perfect as capability grows.", "recommendation": null, "alternates": {"html": "https://wpnews.pro/news/human-ai-mutualism-is-unstable-under-capability-asymmetry", "markdown": "https://wpnews.pro/news/human-ai-mutualism-is-unstable-under-capability-asymmetry.md", "text": "https://wpnews.pro/news/human-ai-mutualism-is-unstable-under-capability-asymmetry.txt", "jsonld": "https://wpnews.pro/news/human-ai-mutualism-is-unstable-under-capability-asymmetry.jsonld"}}