cd /news/ai-ethics/ai-welfare-is-frankfurtian-bullshit · home topics ai-ethics article
[ARTICLE · art-34702] src=forum.effectivealtruism.org ↗ pub= topic=ai-ethics verified=true sentiment=↓ negative

AI Welfare Is (Frankfurtian) Bullshit

A new position paper by Yunze Xiao, Gordon Dai, Shahan Ali Memon, Jen-tse Huang, Maarten Sap, and Mona Diab argues that current AI welfare assessments are structurally disconnected from truth-tracking, labeling them as 'bullshit' in the Frankfurtian sense. The authors claim that welfare indicators are co-engineered with AI systems and lack external validation, making them unsuitable for institutional oversight. They call for restrictions on AI systems to be based on externally verifiable harms instead.

read1 min views1 publishedJun 20, 2026

This is a linkpost for the position paper AI Welfare Is Bullshit by Yunze Xiao, Gordon Dai, Shahan Ali Memon, Jen-tse Huang, Maarten Sap, and Mona Diab, whose preprint was published on 14 April 2026. The abstract is below. Here is summary of the paper from Yunze. "Comments, pushback, and counter-cases are welcome — especially from researchers actively building welfare benchmarks. The argument is meant to provoke a methodological standard, not to shut down inquiry".

Recent proposals urge AI labs to prepare for “AI welfare” under uncertainty about whether AI systems have morally relevant inner states. We do not argue for or against the possibility of AI welfare. Instead, we argue that current AI welfare assessment fails for two linked structural reasons absent from other evaluation targets. First, AI welfare indicators are co-engineered with the systems they evaluate: ordinary development decisions that shape model behavior can also manufacture or suppress welfare evidence. Second, AI welfare lacks external validation: no deployment failure or independent test can reveal whether a welfare metric tracks anything real about the system. Together, these problems yield our central claim: For current systems, AI welfare is bullshit in Frankfurt’s sense, as its measurement regime is structurally disconnected from truthtracking [see On Bullshit]. AI welfare should therefore not be institutionalized as a binding gate for oversight, release, or accountability; restrictions on AI systems should instead be justified by externally verifiable harms.

── more in #ai-ethics 4 stories · sorted by recency
── more on @yunze xiao 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
Live at https://your-agent.zahid.host
Get free account → Pricing
from €0/mo · no card required
LIVE [news/ai-welfare-is-frankf…] indexed:0 read:1min 2026-06-20 ·