{"slug": "bunk-in-af", "title": "Bunk in AF", "summary": "A new analysis of arguments about Agent Foundations (AF) reveals that both proponents and critics of the field can agree on the same premises for fundamentally incompatible reasons. The argument that \"AF needs more empirical grounding\" is deemed meaningless, as it masks a deep disagreement between those who believe AF is a valid non-empirical field and those who think it does not exist at all. This phenomenon, where agreement on premises stems from opposing worldviews, suggests that such consensus should not be taken at face value and may add noise rather than clarity to the debate.", "body_md": "Consider the following argument about [Agent Foundations](https://www.lesswrong.com/w/agent-foundations):\n\nPremise 1: There's a lot of bunk in AF\n\nPremise 2: Some of the bunk in AF would become more valuable by having more empirical grounding\n\nConclusion: AF needs more empirical grounding.\n\nI've argued that the conclusion of this argument is [meaningless](https://www.lesswrong.com/posts/Bz6Hr2h27nJErBxov/af-needs-empirical-grounding-is-a-meaningless-valley-of), and that only two positions make sense: either [AF is possible](https://www.lesswrong.com/posts/Bz6Hr2h27nJErBxov/af-needs-empirical-grounding-is-a-meaningless-valley-of) as a non-empirical field, or [AF doesn't really exist](https://www.lesswrong.com/posts/Bz6Hr2h27nJErBxov/af-needs-empirical-grounding-is-a-meaningless-valley-of). Let's say Alice holds the first view, and Bob the second.\n\nI find it interesting that both premises have a property for which I know of no name. If a scissor statement is one which maximizes disagreement, these premises do something like the opposite: they invite agreement from Alice and Bob alike, but for different and incompatible reasons — which means the agreement shouldn't be taken at face value.\n\nBob agrees with Premise 1 because he thinks AF is full of non-empirical bunk, and takes this as an indictment of the pseudo-field. Alice agrees with Premise 1 because she thinks AF is still pre-paradigmatic, so some failed attempts will almost inevitably be bunk or close to bunk, and she sees them as a positive sign that people are trying to push the field forward.\n\nSimilarly, Bob thinks that some of the bunk — the valuable part! — could be salvaged by being turned into empirical research. Alice thinks that some of the bunk — the part that doesn't belong in AF! — could be salvaged by abandoning its AF framing and aiming to be something else. Bob eliminates the field and saves the valuable parts by transforming them. Alice saves the field by filtering out the bunk, and as a side effect some of that bunk becomes good empirical research — though Alice isn't particularly interested in what happens to those parts.\n\nAlice and Bob both agree with the premises and both disagree with the conclusion. But their disagreement with the conclusion flows from a deep agreement, while their agreement on the premises flows from a deep disagreement.\n\nTL;DR: Agreeing or disagreeing with a badly formulated argument provides little information about what someone thinks, and might just add noise.", "url": "https://wpnews.pro/news/bunk-in-af", "canonical_source": "https://www.lesswrong.com/posts/q2hHDjMDwyAHh92ek/bunk-in-af", "published_at": "2026-06-12 18:40:50+00:00", "updated_at": "2026-06-12 18:57:26.440774+00:00", "lang": "en", "topics": ["ai-safety", "ai-research"], "entities": [], "alternates": {"html": "https://wpnews.pro/news/bunk-in-af", "markdown": "https://wpnews.pro/news/bunk-in-af.md", "text": "https://wpnews.pro/news/bunk-in-af.txt", "jsonld": "https://wpnews.pro/news/bunk-in-af.jsonld"}}