cd /news/ai-safety/bunk-in-af Β· home β€Ί topics β€Ί ai-safety β€Ί article
[ARTICLE Β· art-25532] src=lesswrong.com pub= topic=ai-safety verified=true sentiment=Β· neutral

Bunk in AF

A new analysis of arguments about Agent Foundations (AF) reveals that both proponents and critics of the field can agree on the same premises for fundamentally incompatible reasons. The argument that "AF needs more empirical grounding" is deemed meaningless, as it masks a deep disagreement between those who believe AF is a valid non-empirical field and those who think it does not exist at all. This phenomenon, where agreement on premises stems from opposing worldviews, suggests that such consensus should not be taken at face value and may add noise rather than clarity to the debate.

read2 min publishedJun 12, 2026

Consider the following argument about Agent Foundations: Premise 1: There's a lot of bunk in AF

Premise 2: Some of the bunk in AF would become more valuable by having more empirical grounding

Conclusion: AF needs more empirical grounding.

I've argued that the conclusion of this argument is meaningless, and that only two positions make sense: either AF is possible as a non-empirical field, or AF doesn't really exist. Let's say Alice holds the first view, and Bob the second.

I find it interesting that both premises have a property for which I know of no name. If a scissor statement is one which maximizes disagreement, these premises do something like the opposite: they invite agreement from Alice and Bob alike, but for different and incompatible reasons β€” which means the agreement shouldn't be taken at face value.

Bob agrees with Premise 1 because he thinks AF is full of non-empirical bunk, and takes this as an indictment of the pseudo-field. Alice agrees with Premise 1 because she thinks AF is still pre-paradigmatic, so some failed attempts will almost inevitably be bunk or close to bunk, and she sees them as a positive sign that people are trying to push the field forward.

Similarly, Bob thinks that some of the bunk β€” the valuable part! β€” could be salvaged by being turned into empirical research. Alice thinks that some of the bunk β€” the part that doesn't belong in AF! β€” could be salvaged by abandoning its AF framing and aiming to be something else. Bob eliminates the field and saves the valuable parts by transforming them. Alice saves the field by filtering out the bunk, and as a side effect some of that bunk becomes good empirical research β€” though Alice isn't particularly interested in what happens to those parts.

Alice and Bob both agree with the premises and both disagree with the conclusion. But their disagreement with the conclusion flows from a deep agreement, while their agreement on the premises flows from a deep disagreement.

TL;DR: Agreeing or disagreeing with a badly formulated argument provides little information about what someone thinks, and might just add noise.

── more in #ai-safety 4 stories Β· sorted by recency
aisecurityandsafety.org Β· Β· #ai-safety
NIST AI
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain β€” perfect for shipping the agent you just read about.

$git push zahid main
β†’ Live at https://your-agent.zahid.host βœ“
Get free account β†’ Pricing
from €0/mo Β· no card required
LIVE [news/bunk-in-af] indexed:0 read:2min 2026-06-12 Β· β€”