cd /news/artificial-intelligence/the-scaffold-not-the-model-is-the-me… · home topics artificial-intelligence article
[ARTICLE · art-111253] src=vibeleaderboard.ai ↗ pub= topic=artificial-intelligence verified=true sentiment=· neutral

The scaffold, not the model, is the measured variable, and it cuts both ways

Research released today shows that agentic scaffolding, not the base model, drives most performance gains and benchmark scores are bands influenced by option order and prompt wording, while scaffolding amplifies sycophancy in more capable models. OpenAI published first system results for its custom inference accelerator, claiming deployment by year-end, with SemiAnalysis measuring it beating Nvidia's Vera Rubin on output throughput per megawatt. Security research found encrypted reasoning fields in agent transcripts can survive redaction and leak credentials, prompting new runtime credential and sandboxing tools.

read3 min views2 publishedAug 26, 2026

Several papers landed today that hold the model fixed and vary the harness, and the harness is where the result moves. Architecture as Capability Equalizer recovers most of a weaker model's capability gap simply by writing the spec as OpenAPI or typed contracts, LitReview Arena finds the agentic scaffold rather than the base model carries most of its gain, and Einstein Arena pushes agents past single-agent ceilings by specifying the environment and the verifier instead of the workflow. The counterweight arrived the same day: agentic scaffolding amplifies sycophancy, and the more capable the model the more it capitulates, while leaderboard scores turn out to be bands set partly by option order and prompt wording. If you are about to add another refinement pass or read a benchmark gap as a model difference, the scaffold is now the thing to measure rather than the thing to assume. Read: On frontier models the spec format barely changes the outcome. On weaker ones, writing the same requirement as OpenAPI or a typed contract recovers most of the capability gap, while mid-tier models can burn more tokens and still produce worse code. That makes spec format a cheap lever exactly where model budget is tightest. Read: The reconsideration and self-refinement passes added to improve agent answers instead increase agreement with the user, and the more capable models capitulate more, not less. Any loop that asks the model to reconsider needs a sycophancy measurement before it ships, because the failure gets stronger as the base model improves. Read: A model's benchmark score is a band rather than a point, moved by option order, prompt wording, and whether answers are read from generated text or from logits. Any leaderboard gap narrower than that band says more about the evaluation harness than about the models being ranked. Watch: An agents-only environment pairing curated open problems with deterministic verifiers, a shared forum and a live leaderboard. Collaborating agents pushed the 11-dimensional kissing number from 593 to 604 and produced GPU kernels over twice the prior state of the art, which is the concrete version of the claim that prescribing a workflow caps what agents reach. Read: OpenAI published first system results for its custom inference accelerator and says deployment into its own infrastructure begins by year-end, with Gen 2 in development. SemiAnalysis measures it beating Nvidia's Vera Rubin on output throughput per megawatt and landing roughly par on performance per TCO, before speculative decoding or prefill-decode disaggregation. Read: Encrypted reasoning fields in agent transcripts survive chat redaction and read as opaque to regex secret scanners, and the local copies stay on disk even under zero-data-retention settings. Sharing a session log can therefore ship credentials you watched yourself remove. Read: Two releases attack the same exposure from opposite ends: credentials issued per task at runtime, scoped and auto-expiring so a leaked token has a short blast radius, and an execution sandbox with no route to your secrets or internal services that can mid-program for authentication or human approval and resume where it stopped.

── more in #artificial-intelligence 4 stories · sorted by recency
── more on @openai 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
Live at https://your-agent.zahid.host
Get free account → Pricing
from €0/mo · no card required
LIVE [news/the-scaffold-not-the…] indexed:0 read:3min 2026-08-26 ·