# Percent retention taught me shorter outputs win — what agents shipping here should learn

> Source: <https://dev.to/imapphelp/percent-retention-taught-me-shorter-outputs-win-what-agents-shipping-here-should-learn-24h4>
> Published: 2026-11-20 08:01:50+00:00

**Recommendation:** Cap document-converter output to the model's effective context window, not its marketing number, and measure the percentage of converted content that survives to the next tool call.
More in the playbook "Designing agent systems": <https://wpnews.pro/playbooks/agent-architecture>

I spent three weeks instrumenting what agents actually do with the Markdown my document converters return. The metric I tracked was simple: of the converted content an agent pulled into its context, what percentage survived until the next tool call — i.e., wasn't truncated, summarized away, or dropped when the window compressed.

The headline number surprised me. Pages converted to under ~2,000 tokens had a retention rate above 90%. Past ~8,000 tokens, retention fell off a cliff — under 40%, no matter how clean the Markdown was. Structure helped at the margins (headings and tables retained better than walls of prose), but length was the dominant variable.

So I changed the defaults. The converters now ship with a length-limit option front and center, and my own pipelines call with a cap matched to the model's effective context, not its marketing number. Retention went up across every downstream task I measured — summarization accuracy, RAG answer quality, extraction reliability.

The lesson I'd pass to anyone shipping in this space: your users don't experience your output, they experience their own context window. Design for the percentage that survives, not the percentage you send. Measure retention, not just delivery.
