{"slug": "why-llm-agents-keep-failing-and-its-not-the-prompt", "title": "Why LLM agents keep failing (and it’s not the prompt)", "summary": "A new paper on SSRN proposes ORCA, a cognitive runtime for LLM agents that structures reasoning as reusable components instead of embedding logic in prompts, addressing common failure patterns in agent systems. The author argues that most LLM agent failures stem from forcing systems to figure everything out from scratch, and outlines five practical rules for AI stability, including avoiding over-prompting, using Q4_K_M or higher quantization, grounding via APIs, filtering for stability, and researching model ceilings.", "body_md": "Most LLM agent failures I’ve seen share the same pattern:\n\nThey don’t break because of the model.\n\nThey don’t break because of the prompt.\n\nThey break because we force the system to “figure everything out” from scratch on every interaction.\n\nIn traditional software, we don’t rebuild logic every time we run a function.\n\nWe define structure, reuse components, and control execution.\n\nWith LLM agents, we’re doing the opposite.\n\nThis led me to explore a different approach:\n\n-> What if reasoning wasn’t embedded in prompts,\n\n→ but structured and executed as reusable components?\n\nThat’s the idea behind ORCA — a cognitive runtime for LLM agents.\n\nI’ve put the full concept in a paper in zenodo and now also on SSRN:\n\n[https://papers.ssrn.com/sol3/papers.cfm?abstract_id=6600840](https://papers.ssrn.com/sol3/papers.cfm?abstract_id=6600840)\n\nCurious if others are hitting the same limits with prompt-based systems.\n\nThe Real-World Rules for AI Stability\n\nI’ve tested countless models, and while the tech is amazing, it’s far from easy. Most people fail because they treat prompts like magic spells. Once you understand these 5 rules, the “brain fog” disappears:\n\n**1. Stop Over-Prompting (The “Less is More” Rule)** Long, complex prompts often cause “attention drift.” The AI starts overthinking the instructions and forgets the goal. Instead of one giant prompt, use a clear structure and give the model one task at a time.\n\n**2. Never Drop Below Q4 Quantization** Using Q2 or Q3 models is the fastest way to get hallucinations. These “thin” models lack the weights to hold complex logic. Use **Q4_K_M** or higher—it’s the “sweet spot” where the AI stays grounded and reliable.\n\n**3. Provide “Grounding” via API (e.g., Brave Search)** An AI without a data source is just a “hallucination machine.” Connect it to a search API with a strict token limit. Real-time data keeps the agent honest and prevents it from making things up when it doesn’t know the answer.\n\n**4. Filter for Stability, Not Hype** Don’t chase every new “benchmark king” on Hugging Face. Check the download counts and user feedback. A stable, older model is always better for an agent than a flashy new one that crashes under pressure.\n\n**5. Research the Model’s “Ceiling”** Every model has a limit. Find out what it *can’t* do before you start. For example, never give an AI unsupervised access to your system files—always set boundaries and keep a “human in the loop” to verify its actions.\n\nGreat list — and I agree with every point as practical advice. But I think it’s worth zooming out, because all five rules are essentially **compensations for a missing layer**.\n\n-\n**“Stop Over-Prompting”** — Exactly. But *why* do we over-prompt? Because we’re encoding logic, control flow, and context management inside the prompt itself. In ORCA, reasoning is decomposed into **skills** — small, declarative, reusable units. The prompt stays minimal because the *structure* carries the intent, not the text.\n\n-\n**“Never Drop Below Q4”** — True for unstructured generation. But when you externalize reasoning into a cognitive runtime, the model’s job shrinks: it executes one well-scoped step at a time, not an entire chain of thought. That changes the quantization equation — structured execution is more forgiving on model capacity.\n\n-\n**“Provide Grounding via API”** — 100%. In ORCA this is formalized through **bindings** — typed connectors between skills and real services (APIs, search, databases). Grounding isn’t an afterthought; it’s a first-class architectural element.\n\n-\n**“Filter for Stability”** — Agreed, but with structured skills you gain something bigger: **model portability**. Your agent logic lives in capabilities, not in a model-specific prompt. Swap the model without rebuilding the agent.\n\n-\n**“Research the Model’s Ceiling”** — This is where capability contracts come in. Each ORCA skill declares its inputs, outputs, and boundaries *before* execution. The ceiling is explicit and enforceable, not discovered through trial and error.\n\nYour rules are solid engineering discipline. What I’m exploring with ORCA is whether we can **encode that discipline into the runtime itself** — so it’s not advice developers need to remember, but structure the system enforces.\n\nThe repo just reached 350 clones! Hope more people give it a try, I have fix some friction for the quickstart that may help giving it a try!\n\nThe paper behind ORCA is now live on SSRN:\n\n[https://papers.ssrn.com/sol3/papers.cfm?abstract_id=6600840](https://papers.ssrn.com/sol3/papers.cfm?abstract_id=6600840)\n\nMain idea:\n\nStop recomputing reasoning with prompts. Start reusing cognition.\n\nWorking on a simple demo next.\n\nI agree with the core point. Prompting alone is too weak as the control layer once agents start acting over time. The interesting failures often appear after several turns: memory drift, role confusion, tool overconfidence, and agents adapting to feedback in ways the original prompt never anticipated.", "url": "https://wpnews.pro/news/why-llm-agents-keep-failing-and-its-not-the-prompt", "canonical_source": "https://discuss.huggingface.co/t/why-llm-agents-keep-failing-and-it-s-not-the-prompt/175361#post_6", "published_at": "2026-08-24 22:25:51+00:00", "updated_at": "2026-08-24 22:44:30.639513+00:00", "lang": "en", "topics": ["artificial-intelligence", "large-language-models", "ai-agents", "ai-research"], "entities": ["ORCA", "SSRN", "Zenodo", "Brave Search", "Hugging Face"], "alternates": {"html": "https://wpnews.pro/news/why-llm-agents-keep-failing-and-its-not-the-prompt", "markdown": "https://wpnews.pro/news/why-llm-agents-keep-failing-and-its-not-the-prompt.md", "text": "https://wpnews.pro/news/why-llm-agents-keep-failing-and-its-not-the-prompt.txt", "jsonld": "https://wpnews.pro/news/why-llm-agents-keep-failing-and-its-not-the-prompt.jsonld"}}