{"slug": "talk-like-a-caveman-prompts-save-tokens-but-far-less-than-promised", "title": "‘Talk like a caveman’ prompts save tokens, but far less than promised", "summary": "JetBrains tested the viral 'Caveman' prompting style for AI coding assistants and found it reduces token usage by only 8.5%, far less than the claimed 65%. The technique trims conversational padding but has limited impact because most tokens are consumed by reading files, reasoning, and generating code. JetBrains engineer Denis Shiryaev noted that the method does not impair code quality or task success rates.", "body_md": "Developers looking to curb the cost of AI-powered coding tools have increasingly turned to the “Caveman” prompting style, which instructs coding assistants to communicate in blunt, telegraphic language and avoid conversational padding. The theory is simple: fewer words mean fewer tokens, translating into lower inference costs for organizations deploying AI agents at scale.\n\nA new test from IDE maker JetBrains confirms that terse prompting styles such as the viral open-source [Caveman project](https://github.com/juliusbrussee/caveman) can reduce token usage without hurting coding performance. However, the company found that the savings were far smaller than supporters claim.\n\nJetBrains used the Harbor open-source evaluation framework and tasks from SkillsBench for its test, and found that the Caveman technique reduced usage of output tokens by about 8.5%, far below its claimed 65%.\n\nThe IDE-maker ran paired benchmarks across 86 real-world software engineering tasks in [Claude Code](https://www.infoworld.com/article/3853805/vibe-coding-with-claude-code.html), comparing coding sessions that used the Caveman prompting style against otherwise identical sessions without it.\n\nWhile an initial evaluation of just 10 tasks indicated savings to the tune of about 30%, the reduction fell to about 8.5% as the test progressed, JetBrains engineer [Denis Shiryaev](https://www.linkedin.com/in/dshiryaev), wrote in a [blog post](https://blog.jetbrains.com/ai/2026/07/speak-to-ai-agents-like-cavemen-tosave-tokens/), suggesting that the Caveman technique’s impact was less pronounced across a broader and more representative workload.\n\nThe open-source Caveman project suggests that if an agent drops the conversational padding around responses and communicates in terse, telegraphic fragments, the token outputs saved could translate into meaningful savings at scale.\n\nThat assumption, according to Shiryaev, does not fully account for how modern coding agents use tokens.\n\nWhile shorter prompts and responses do reduce the amount of text exchanged with users, the engineer said the bulk of token consumption in agentic coding workflows comes from reading project files, reasoning through tasks, invoking tools and generating code, limiting the overall savings from trimming conversational language alone.\n\nFurther, the engineer pointed out that translating token savings into lower operating costs may not always be straightforward for enterprises.\n\nAlthough the Caveman technique, during testing, generally resulted in lower costs on individual coding tasks, the cumulative cost of the full benchmark was higher for the Caveman runs after a single dependency-audit task crossed Claude Code’s long-context pricing tier, Shiryaev pointed out.\n\nThat same task had produced a similar cost outlier in an earlier baseline run, indicating that the anomaly reflected the workload rather than the prompting technique itself, Shiryaev added.\n\nHowever, not all of JetBrains’ findings undercut the Caveman technique.\n\nThe test found no detectable impact on task success rates, code quality or execution time, Shiryaev said, suggesting that while the prompting style may not deliver the dramatic token savings claimed by its proponents, it also did not impair the coding agent’s effectiveness.\n\nBeyond simple cost saving, the findings from the test also add nuance to a growing body of prompt-engineering techniques aimed at reducing AI inference costs.\n\nBesides the Caveman project, other approaches, including data analyst [Drona Reddy’s](https://www.linkedin.com/in/drona-reddy/) [Markdown-based prompting technique](https://www.infoworld.com/article/4152333/how-to-halve-claude-output-costs-with-a-markdown-tweak.html), have claimed meaningful token savings.\n\nFor now, enterprises and their leaders should view such prompt-engineering techniques as optimizations to be validated rather than assumptions to be adopted, with production workloads ultimately determining whether the promised savings materialize.", "url": "https://wpnews.pro/news/talk-like-a-caveman-prompts-save-tokens-but-far-less-than-promised", "canonical_source": "https://www.infoworld.com/article/4193775/talk-like-a-caveman-prompts-save-tokens-but-far-less-than-promised.html", "published_at": "2026-07-07 12:28:50+00:00", "updated_at": "2026-07-07 12:34:23.167926+00:00", "lang": "en", "topics": ["ai-tools", "large-language-models", "developer-tools", "ai-agents"], "entities": ["JetBrains", "Caveman", "Claude Code", "Denis Shiryaev", "Harbor", "SkillsBench", "Drona Reddy"], "alternates": {"html": "https://wpnews.pro/news/talk-like-a-caveman-prompts-save-tokens-but-far-less-than-promised", "markdown": "https://wpnews.pro/news/talk-like-a-caveman-prompts-save-tokens-but-far-less-than-promised.md", "text": "https://wpnews.pro/news/talk-like-a-caveman-prompts-save-tokens-but-far-less-than-promised.txt", "jsonld": "https://wpnews.pro/news/talk-like-a-caveman-prompts-save-tokens-but-far-less-than-promised.jsonld"}}