{"slug": "the-load-bearing-vocabulary-of-claude", "title": "The Load-Bearing Vocabulary of Claude", "summary": "A data analysis by Louis Abraham shows that Claude's GitHub pull request descriptions have become increasingly repetitive, with one of eight writing styles growing from 1.0% of the corpus in early 2025 to 45% by mid-2026. Anthropic plans to use Google's SynthID-Text watermarking, which Google's white paper admits incurs 'some reduction to inter-response diversity', potentially worsening the issue.", "body_md": "Fun (but depressing?) data analysis project from Louis Abraham, showing how repetitive Claude is in the words it chooses when submitting GitHub pull requests. Abraham, in the project’s readme:\n\nGitHub pull request descriptions, grouped by the words they are written with rather than by anything they were told to look for: eight ways of writing, and every description belongs to one of them. One of the eight was 1.0% of the corpus at the start of 2025 and is 45% of it by the middle of 2026.\n\nIf you want to get a little more depressed, I’ve been doing deeper reading into AI watermarking research, and one of the admissions in [Google’s white paper on SynthID-Text](https://www.nature.com/articles/s41586-024-08025-4) — the watermarking scheme Anthropic says Claude is going to start using — is that the technique incurs “some reduction to inter-response diversity”. That means different answers to the same prompt become more similar to each other — there’s less variety to watermarked text responses. That’s a load-bearing problem given that Claude clearly already struggles in this regard *before* watermarking its output.", "url": "https://wpnews.pro/news/the-load-bearing-vocabulary-of-claude", "canonical_source": "https://louisabraham.github.io/load-bearing/", "published_at": "2026-08-27 21:09:42+00:00", "updated_at": "2026-08-27 21:18:22.596752+00:00", "lang": "en", "topics": ["artificial-intelligence", "large-language-models", "ai-research", "ai-products"], "entities": ["Louis Abraham", "Claude", "Anthropic", "Google", "SynthID-Text"], "alternates": {"html": "https://wpnews.pro/news/the-load-bearing-vocabulary-of-claude", "markdown": "https://wpnews.pro/news/the-load-bearing-vocabulary-of-claude.md", "text": "https://wpnews.pro/news/the-load-bearing-vocabulary-of-claude.txt", "jsonld": "https://wpnews.pro/news/the-load-bearing-vocabulary-of-claude.jsonld"}}