cd /news/ai-agents/why-i-have-my-orchestrator-compact-a… · home › topics › ai-agents › article
[ARTICLE · art-170876] src=dev.to ↗ pub= topic=ai-agents verified=true sentiment=· neutral

Why I have my orchestrator compact at 100K tokens

A developer who runs Claude Opus 5.5 agents with a 1M-token context window reports compacting the orchestrator at 100K tokens, citing observed drift past roughly 200K tokens and warning that orchestrator drift propagates through subagent briefs. The writeup points to Anthropic's session-management guidance and Chroma's July 2025 context-rot evaluation of 18 LLMs, which found performance grows increasingly unreliable as input length grows, and notes that prompt caching cuts the price of 100K input tokens to as little as $0.02 on a cache hit without reducing the token count. It also flags compaction's downsides, including lossy summaries and broken prefix-cache reuse, and proposes a repeatable comparison logging input and cache token counts.

by read2 min views14 publishedNov 16, 2026

Claude Opus 5.5 has a 1M token context window. I keep every agent under 100K anyway. Past 200K a slight drift sets in.

These are personal observations, not measured thresholds.

When a subagent drifts, you can get a weaker answer back. When the orchestrator drifts, that drift can spread through its briefs.

Claude Code's subagents normally start with a fresh, isolated context window. Forks inherit the parent conversation instead. A fresh subagent gets its task through the orchestrator's brief. Without the history, it may miss a constraint the brief dropped.

Anthropic's session guide warns that growing context can hurt performance. Claude Code summarizes automatically near the window's limit. The guide recommends compacting earlier and saying what comes next.

/context
/compact focus on the auth refactor, drop the test debugging

/context shows what's filling the window. The /compact line is the guide's own example. Codex has /compact too.

Chroma's Kelly Hong, Anton Troynikov and Jeff Huber evaluated 18 LLMs in July 2025. Performance "grows increasingly unreliable as input length grows". The models included GPT-4.1 and Claude 4, not Opus 5.5. Neither source draws a line at 100K or 200K.

For 100K input tokens on Opus 5.5, using API prices checked on November 3, 2026:

Billed as Per million tokens 100K tokens
Uncached input $4 $0.40
Cache write, 5 minutes $5 $0.50
Cache write, 1 hour $8 $0.80
Cache hit $0.20 $0.02

Each amount is the listed rate multiplied by one tenth. These are input costs only; output and tool charges are excluded. They are not subscription prices. Other models have other multipliers.

The hit is 0.05× the input price, and it doesn't buy room. Anthropic's words: "prompt caching changes what you pay for those tokens, not whether they count."

Compaction also rewrites the history. Hits need 100 percent identical prompt segments, so the unchanged start can still hit, and the rewritten part can't. CompactionBench, from Microsoft researchers, lists "disrupting prefix-cache reuse" among the problems.

Amp removed compaction on October 23, 2025 and replaced it with Handoff. It calls compaction lossy: the agent decides what survives in the summary. Compacting early still carries that risk. A constraint you stated early can disappear.

This comparison has not been run for this article.

/context``/compact. Restore the repo snapshot before each run. Repeat each comparison.

task,model,effort,input_tokens,compacted,run,tests_passed,constraints_kept

On the API, log input_tokens, cache_read_input_tokens and cache_creation_input_tokens. Those separate uncached input from cache reads and writes.

The maintained article, with all ten context terms and what each does to the budget, is on argbe.tech.

── more in #ai-agents 4 stories · sorted by recency
── more on @anthropic 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/why-i-have-my-orches…] indexed:0 read:2min 2026-11-16 · —