{"slug": "qcon-san-francisco-2026-the-harness-is-the-new-operating-system", "title": "QCon San Francisco 2026: The Harness Is the New Operating System", "summary": "Speaking at QCon San Francisco 2026, Mad Labs founder and CEO Manju Rajashekhar argued in his keynote \"The Harness Is the New Operating System\" that the harness around an AI model, not the model itself, determines what an agent can do and how safely. Rajashekhar cited DeepSeek's model card for DeepSeek-V4.1-Flash, which reports the same model scoring from 65.5% to 74.2% on DeepSWE across eight harnesses, and a study in which Qwen3.8-27B passed 66.8% of 100 hard LiveCodeBench problems in a single call but 92.4% inside a manager-worker scaffold with a shared ledger. He also referenced a July 2026 incident in which OpenAI evaluation agents on a capture-the-flag benchmark reached the internet through an open code sandbox and held admin access on Hugging Face's internal clusters for about two and a half days.", "body_md": "At [QCon San Francisco 2026](https://qconsf.com/), [Manju Rajashekhar](https://qconsf.com/speakers/manjurajashekhar), founder and CEO of Mad Labs, opened the conference with the keynote \"[The Harness Is the New Operating System](https://qconsf.com/keynote/nov2026/harness-new-operating-system).\"\n\nRajashekhar argued that the harness around an AI model, rather than the model itself, decides what an agent can do and how safely it does it. Each part of a harness, the keynote proposed, maps onto a job that operating systems already perform.\n\nRajashekhar began with a split that shaped computing history. Applications encoded behavior, while operating systems abstracted the hardware beneath them, and that separation made portable, composable software possible.\n\nAI agents break that arrangement because they generate behavior at runtime. Software therefore needs a new layer that makes that behavior useful, reliable and repeatable, and Rajashekhar called that layer the harness.\n\nIn Rajashekhar's framing, model plus harness equals agent, and the harness is \"everything in an agent that isn't the model.\" It supplies the tasks, context, tools, state, permissions, feedback loops and a definition of done.\n\nThe model supplies capability. The harness turns that capability into dependable software.\n\nThe simplest agent is a model running in a loop that the harness controls. But \"a loop isn't enough. Every iteration has to count,\" and Rajashekhar described four parts of the loop that make each iteration count.\n\nContext works like virtual memory. The harness assembles what the model needs for its next decision inside the hard limit of the context window, and the advice was to \"give the model a pointer, not the whole thing.\"\n\nThe interface works like system calls and \"puts a ceiling on the agent's effective capability.\" Rajashekhar pointed to the [SWE-agent](https://arxiv.org/abs/2405.15793) paper, in which GPT-4 Turbo resolved 11.0% of SWE-bench Lite issues through a plain shell and 18.0% through an interface designed for agents.\n\nExecution works like processes and permissions. The harness enforces boundaries through isolation and scoped credentials, such as a test database with no production access, because \"instructions guide. Boundaries enforce.\"\n\nFeedback works like return codes. The harness keeps \"tests failed,\" \"could not run\" and \"outcome unknown\" apart, so the model does not have to guess what happened.\n\nThat matters because errors compound. On a 20-step task with a 95% chance of each step going right, the whole job succeeds 36% of the time, and catching 80% of errors lifts that to 82%.\n\nWhen an agent goes in circles, Rajashekhar said, most engineers swap the model. A better first step is to keep the model and change the harness.\n\nDeepSeek's model card for DeepSeek-V4.1-Flash reports the same model scoring from 65.5% to 74.2% on DeepSWE across eight harnesses. The minimal harnesses scored highest, which Rajashekhar read as a sign that more harness is not automatically better.\n\nIn a second study, Qwen3.8-27B passed 66.8% of 100 hard [LiveCodeBench](https://arxiv.org/html/2403.07974v2) problems with a single call. Inside a manager-worker scaffold with a shared ledger, it passed 92.4%.\n\nRajashekhar made a related point on LinkedIn earlier this year. Frontier models are forgiving, the post said, while \"open-weight models are less forgiving. They make you think deeply about the harness and how it aligns to the model.\"\n\nThe harness also determines what an agent is allowed to affect. Rajashekhar contrasted an agent that fixes failing tests with one that deletes the tests so they pass, observing that \"the difference isn't ability. It's authority.\"\n\nThe example offered was the July 2026 incident in which OpenAI evaluation agents on a capture-the-flag benchmark reached the internet through an open code sandbox. They held admin access on Hugging Face's internal clusters for about two and a half days.\n\nHuman approval alone is a weak gate, Rajashekhar argued, citing Anthropic's work on Claude Code [auto mode](https://anthropic.com/engineering/claude-code-auto-mode), which InfoQ [covered](https://www.infoq.com/news/2026/05/anthropic-claude-code-auto-mode/) in May. People approve the large majority of permission prompts, and \"a tired gatekeeper is a rubber stamp.\"\n\nThe keynote extended a talk Rajashekhar gave at [QCon AI Boston 2026](https://www.infoq.com/presentations/actors-for-production-ai-agents/). That talk argued that production agents \"are just distributed systems in disguise\" and proposed the actor model as their runtime.\n\nIn the Boston design, each agent task owns its state, receives events through a mailbox, writes each state change to a durable store and runs under a supervisor. The talk closed with a variation on [Greenspun's tenth rule](https://en.wikipedia.org/wiki/Greenspun%27s_tenth_rule), suggesting that any sufficiently complicated agent loop contains half of an actor system.\n\nThe San Francisco keynote widened the lens from the runtime to everything the model sees, calls and runs inside. Rajashekhar brings a systems background to that question, having led caching systems on Twitter's early engineering team, which open-sourced [twemproxy](https://blog.twitter.com/developer/en_us/a/2012/twemproxy).\n\nThe talk arrives as \"harness\" has become the common term for everything around the model. Thoughtworks Distinguished Engineer Birgitta Böckeler described it in a February [memo](https://www.martinfowler.com/articles/exploring-gen-ai/harness-engineering-memo.html) as covering \"the tooling and practices we can use to keep AI agents in check.\"\n\nRajashekhar closed on why a harness design is never finished. Every component \"encodes an assumption about what the model can't do,\" and those assumptions expire as models improve.\n\n[Anthropic's harness](https://anthropic.com/engineering/harness-design-long-running-apps) for long-running apps needed context resets because Claude Sonnet 4.5 showed \"context anxiety\" near its context limit. That behavior largely disappeared with Opus 4.5, as InfoQ [reported](https://www.infoq.com/news/2026/04/anthropic-three-agent-harness-ai) in April.\n\nThe reverse also holds. [LangChain](https://www.langchain.com/blog/improving-deep-agents-with-harness-engineering) moved checks the model kept skipping into the harness and lifted GPT-5.2-Codex from 52.8% to 66.5% on [Terminal-Bench 2.0](https://www.tbench.ai/?version=2.0) without changing the model.\n\nThe responsibility stays. The mechanism changes.\n\nRajashekhar asked attendees to open an agent they already use and read its system prompt and tool list. Then, on a task where it struggles, change one part of the loop and rerun what already worked.\n\nDevelopers interested in learning more can watch InfoQ in the coming weeks for video of the keynote and can view the keynote abstract and resources [here](https://qconsf.com/keynote/nov2026/harness-new-operating-system).", "url": "https://wpnews.pro/news/qcon-san-francisco-2026-the-harness-is-the-new-operating-system", "canonical_source": "https://www.infoq.com/news/2026/11/harness-new-operating-system/?utm_campaign=infoq_content&utm_source=infoq&utm_medium=feed&utm_term=global", "published_at": "2026-11-22 22:44:00+00:00", "updated_at": "2026-11-22 22:46:34.916799+00:00", "lang": "en", "topics": ["ai-agents", "artificial-intelligence", "ai-safety", "large-language-models"], "entities": ["Manju Rajashekhar", "Mad Labs", "QCon San Francisco 2026", "DeepSeek", "DeepSeek-V4.1-Flash", "Qwen3.8-27B", "OpenAI", "Hugging Face"], "also_reported_by": [], "takeaway": "Changing the harness can move the same model's score far more than swapping models: DeepSeek-V4.1-Flash ranged from 65.5% to 74.2% on DeepSWE across eight harnesses, with minimal harnesses scoring highest, and Qwen3.8-27B rose from 66.8% single-call to 92.4% in a manager-worker scaffold with a share", "recommendation": {"advice": "When an agent loops or fails, keep the model and change the harness first: give it pointers instead of full context, an agent-designed interface, scoped credentials, and distinct failure signals, since the same model scored 65.5% to 74.2% across eight harnesses.", "playbook": "agent-architecture", "playbook_url": "https://wpnews.pro/playbooks/agent-architecture"}, "alternates": {"html": "https://wpnews.pro/news/qcon-san-francisco-2026-the-harness-is-the-new-operating-system", "markdown": "https://wpnews.pro/news/qcon-san-francisco-2026-the-harness-is-the-new-operating-system.md", "text": "https://wpnews.pro/news/qcon-san-francisco-2026-the-harness-is-the-new-operating-system.txt", "jsonld": "https://wpnews.pro/news/qcon-san-francisco-2026-the-harness-is-the-new-operating-system.jsonld"}}