{"slug": "rule-chaining-hits-95-accuracy-on-arc-agi-2-tasks", "title": "Rule chaining hits 95% accuracy on ARC-AGI-2 tasks", "summary": "A three-stage rule-chaining framework described in arXiv:2609.10654v1 solved 230 of 240 tasks on the ARC-AGI-2 benchmark, according to the paper's reported results. The system uses a fallback hierarchy that first attempts deterministic rule discovery, then pattern composition, and finally structural abstraction, and it also passed 995 of 1000 internal training tasks and 105 of 120 evaluation-set tasks without task-specific tuning. The approach's ceiling remains tied to how its initial atomic symbolic rules are defined, since transformations outside those predefined categories are pushed to the more computationally expensive abstraction layer.", "body_md": "# Rule chaining hits 95% accuracy on ARC-AGI-2 tasks\n\nThe ARC-AGI-2 benchmark is notoriously difficult because it demands cognitive generalization rather than pattern matching. The approach detailed in arXiv:2609.10654v1 shifts away from raw LLM guessing and instead uses a three-stage fallback hierarchy. It essentially treats the grid problem as a sequence of symbolic transformations—first trying deterministic rules, then pattern composition, and finally structural abstraction—which allows the system to solve 230 out of 240 test tasks.\n\n## How the rule-chaining hierarchy actually works\n\nThe framework doesn't just throw a prompt at the problem; it runs a sequence of solvers where each stage depends on the failure of the previous one.\n\n1. **Deterministic Rule Discovery:** This is the first line of defense. It looks for atomic transformations. If a pixel moves from (x,y) to (x+1,y) or changes color based on a fixed rule, this module catches it. It handles the \"easy\" geometric shifts.\n\n2. **Pattern-Composition Engine:** If the deterministic check fails, it moves here. This stage looks for blocks. It tries to see if the output is just the input block mirrored, repeated, or merged with another block. It uses spatial heuristics to find these repeating units.\n\n3. **Structural Abstraction Layer:** This is the final fallback for the hardest tasks. It attempts to find hierarchical relationships—like a small grid being nested inside a larger grid—and infers rules based on those nested relationships.\n\n## Performance and validation numbers\n\nThe data shows this isn't just a theoretical improvement. The system was validated across three different sets:\n\n- **Internal training:** Passed 995 out of 1000 tasks.\n- **Evaluation set:** Solved 105 out of 120 tasks.\n- **ARC-AGI-2 Test set:** Solved 230 out of 240 tasks.\n\n## When this approach fails\n\nWhile the numbers are high, this framework relies heavily on the \"atomic\" definitions in the first stage. If the transformation doesn't fit into the predefined categories of geometric, color, or object-based analysis, the system is forced into the more computationally expensive abstraction layer. This suggests that the system's ceiling is still tied to how we define those initial symbolic rules.\n\nThe lack of task-specific tuning is the biggest win here. Because it uses a general fallback hierarchy, it doesn't need to be \"told\" what kind of puzzle it's solving; the framework discovers the rule type through the failure of the previous stage.\n\n[Next Paul Ford is right that AI makes it too easy to do a job badly →](/en/news/9274/)\n\n## All Replies （3）\n\nSo relieved to see this. I wasted a month fighting logic gaps in my own script using Prolog, but kept hitting error 402...", "url": "https://wpnews.pro/news/rule-chaining-hits-95-accuracy-on-arc-agi-2-tasks", "canonical_source": "https://promptcube3.com/en/news/9295/", "published_at": "2026-09-13 02:15:54+00:00", "updated_at": "2026-09-13 02:28:07.643886+00:00", "lang": "en", "topics": ["artificial-intelligence", "ai-research", "machine-learning", "large-language-models"], "entities": ["ARC-AGI-2", "arXiv:2609.10654v1", "Prolog"], "alternates": {"html": "https://wpnews.pro/news/rule-chaining-hits-95-accuracy-on-arc-agi-2-tasks", "markdown": "https://wpnews.pro/news/rule-chaining-hits-95-accuracy-on-arc-agi-2-tasks.md", "text": "https://wpnews.pro/news/rule-chaining-hits-95-accuracy-on-arc-agi-2-tasks.txt", "jsonld": "https://wpnews.pro/news/rule-chaining-hits-95-accuracy-on-arc-agi-2-tasks.jsonld"}}