{"slug": "nvidia-researchers-argue-huge-ai-context-windows-are-a-dead-end", "title": "Nvidia researchers argue huge AI context windows are a dead end", "summary": "Nvidia researchers argue that large language models rarely need their full context windows, which they describe as slow, expensive and error-prone, and propose replacing them with periodic summaries and targeted keyword search. In tests, the summary-and-search approach usually matched full-context results at a fraction of the cost, and the team proposes a new class of models that works with short notes instead of long context.", "body_md": "Nvidia researchers argue that language models often don't need their full context windows—which are slow, expensive, and prone to errors—and propose an alternative. In tests, periodic summaries and targeted keyword search usually matched full-context results at a fraction of the cost. The team even proposes a new class of models that works with short notes instead of long context.\n\nThe article [Nvidia researchers argue huge AI context windows are a dead end](https://the-decoder.com/nvidia-researchers-argue-huge-ai-context-windows-are-a-dead-end/) appeared first on [The Decoder](https://the-decoder.com).", "url": "https://wpnews.pro/news/nvidia-researchers-argue-huge-ai-context-windows-are-a-dead-end", "canonical_source": "https://the-decoder.com/nvidia-researchers-argue-huge-ai-context-windows-are-a-dead-end/", "published_at": "2026-11-21 16:23:45+00:00", "updated_at": "2026-11-21 16:44:08.904932+00:00", "lang": "en", "topics": ["artificial-intelligence", "large-language-models", "ai-research", "ai-infrastructure"], "entities": ["Nvidia", "The Decoder"], "also_reported_by": [], "takeaway": "Periodic summarization plus targeted keyword search usually matched full-context-window results at a fraction of the cost in Nvidia researchers' tests.", "recommendation": {"advice": "Replace full-context stuffing with periodic summaries and targeted keyword search; Nvidia researchers found this usually matched full-context results at a fraction of the cost.", "playbook": "llm-cost", "playbook_url": "https://wpnews.pro/playbooks/llm-cost"}, "alternates": {"html": "https://wpnews.pro/news/nvidia-researchers-argue-huge-ai-context-windows-are-a-dead-end", "markdown": "https://wpnews.pro/news/nvidia-researchers-argue-huge-ai-context-windows-are-a-dead-end.md", "text": "https://wpnews.pro/news/nvidia-researchers-argue-huge-ai-context-windows-are-a-dead-end.txt", "jsonld": "https://wpnews.pro/news/nvidia-researchers-argue-huge-ai-context-windows-are-a-dead-end.jsonld"}}