cd /news/ai-tools/show-hn-atrophy-measure-whether-ai-i… · home topics ai-tools article
[ARTICLE · art-49628] src=github.com ↗ pub= topic=ai-tools verified=true sentiment=· neutral

Show HN: Atrophy – measure whether AI is eroding your unaided coding skill

A developer released Atrophy, a command-line app that measures whether AI assistance is eroding users' unaided coding skills by regularly assigning coding exercises without AI help and tracking skill ratings over time. The tool grades solutions automatically, charts ratings like chess Elo, and highlights the gap between unaided and AI-assisted performance, aiming to reveal hidden skill decline before interviews or outages.

read5 min views1 publishedJul 7, 2026
Show HN: Atrophy – measure whether AI is eroding your unaided coding skill
Image: source

Are you getting worse at coding without AI? Atrophy tells you - with a number.

Atrophy is a command-line app that regularly hands you a small coding exercise to solve without any AI help - no Copilot, no chat, just you and your editor. It grades your solution automatically, keeps a skill rating for you (like a chess Elo), and charts how that rating moves over the weeks. If AI assistance is quietly eroding your ability to code unaided, the chart shows you - before an interview, an outage, or a day without wifi does.

  • once, ~25 minutes. Solve one exercise for each of five skills, AI off. This sets your starting ratings.atrophy baseline

  • 5-10 minutes, two or three times a week. One exercise, automatically picked from the skill you've neglected longest. Pass and your rating rises; fail and it falls.atrophy drill

  • your dashboard. One curve per skill, plus the chart this tool exists for (more below).atrophy serve

Once a month:- take one drillatrophy drill --ai-on

withyour AI tools. Those scores are tracked separately, so the dashboard can show the gap between you-with-AI and you-alone.

$ atrophy drill

Binary search misses the edges  [debugging · python · tier 2]
────────────────────────────────────────────────────────────
binary_search(items, target) should return the index of target in the
sorted list items, or -1 if absent. It mysteriously fails for some
values that are clearly in the list. Find and fix the bug.
────────────────────────────────────────────────────────────
Edit: /tmp/atrophy-k3XoP1/solution.py

AI off. Soft limit 7 min - timer started.

[Enter] submit · [q] abandon >

✓ 6/6 tests passed in 214s

Score 1.00 · debugging rating 1222 → 1241 (+19)

The exercise opens in your own editor ($EDITOR

). Grading runs your code against hidden tests in a sandboxed subprocess. There's a soft time limit - going over shrinks your score gradually, nothing explodes. If tests fail you can keep fixing and resubmit; the clock just keeps running.

Not every skill is "write code against tests" - see the table below.

Skill The drill Graded by
Syntax recall
Write a small function from a spec Hidden tests
Debugging
Working-looking code has one planted bug - find and fix it Hidden tests
Code reading
Read a snippet, type exactly what it prints Compared to the snippet's real output
API memory
Fill in the blanked-out stdlib call Answer match
Decomposition
Outline a design (rate limiter, folder sync…) in bullets You score yourself against a revealed rubric

Exercises come in Python and JavaScript across three difficulty tiers - a hand-written static bank plus generator families that render endless fresh variants (randomized data, names, and twists; same seed always reproduces the same exercise). Difficulty targets you: each drill picks the tier where your predicted success is closest to ~65%, the point where a rep carries the most information. Comfortable wins teach the rating nothing.

atrophy serve   # http://127.0.0.1:4646

** Try the live demo →** (synthetic data)

How to read it:

The line is your skill rating. It only moves when you actually take a drill - no evidence, no movement.The shaded band around the line is confidence. Skip practicing for a few weeks and the band visibly widens: the tool isn't claiming you got worse, it's admitting it no longer knows you're still good. One drill snaps it tight again."Unaided vs AI-assisted" plots every drill score in two colors: your solo reps in blue, your monthly with-AI reps in green. If the blue line sinks while the green line stays perfect, that growing gap is your dependence, measured. This chart is the reason the tool exists.

The pattern is documented across professions, and it comes with no internal warning signal - people consistently feel fine while measurably declining:

  • Doctors' unaided polyp-detection rates fell 28% → 22% within months of routine AI assistance ()The LancetG&H, 2025 - Students with GPT-4 scored 17% worse than peers once it was taken away ()PNAS, 2025 - Experienced developers using AI were 19% slower- while believing they were 20% faster (METR RCT, 2025) - Engineers who used AI to write code scored 17% lower on understanding that same code - debugging suffered most (Anthropic, 2026)

Full citations and an honest discussion of what this tool can and can't measure: docs/research.md.

Requires Node.js ≥ 22, plus Python 3 on PATH

if you want the Python exercises.

npm install -g atrophy
atrophy baseline
Command What it does
atrophy baseline
First session: one drill per skill (~25 min)
atrophy drill
One drill on your most-neglected skill
atrophy drill --axis debugging
Drill a specific skill (syntax-recall , debugging , code-reading , api-memory , decomposition )
atrophy drill --lang python
Only Python (or javascript ) exercises
atrophy drill --ai-on
Monthly comparison rep with AI allowed
atrophy publish --handle you
Opt in to the
--stop opts out)

atrophy stats

atrophy serve

127.0.0.1:4646

atrophy export -o out.json

One SQLite file at ~/.atrophy/atrophy.db

, owned by you. No account, no sync, no telemetry, nothing leaves your machine. ATROPHY_DB

overrides the location if you want it in a dotfiles repo or synced folder.

  • Ten-minute drills are a proxy for real-world skill, not a clinical measurement - treat trends, not absolute numbers, as the signal. - Drilling makes you better at drills. That's fine - the drill isthe maintenance - but it's another reason the interesting number is the unaided-vs-AI gap, not your raw rating. - "AI off" is an honor system, actively assisted: starting an unaided drill while a known AI assistant is running (Copilot, Cursor, Claude, Windsurf, Codeium, Tabnine, Ollama, LM Studio, ChatGPT, Aider) prints a warning that names it. Warned, never blocked - you'd only be cheating your own chart.
git clone https://github.com/ashutosh-rath02/atrophy.git
cd atrophy && npm install
npm run dev -- drill    # CLI from source
npm test                # 70 tests, incl. real grading subprocesses

New exercises are the most welcome contribution: one JSON file under bank/exercises/<skill>/

, validated by bank/schema.ts

. CI proves every planted bug actually fails a test and every code-reading snippet runs deterministically, so a broken exercise can't merge.

Roadmap: LLM-judged decomposition drills, more languages, spaced-repetition scheduling (FSRS), per-axis leaderboards.

MIT © 2026 Ashutosh Rath

── more in #ai-tools 4 stories · sorted by recency
── more on @atrophy 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
Live at https://your-agent.zahid.host
Get free account → Pricing
from €0/mo · no card required
LIVE [news/show-hn-atrophy-meas…] indexed:0 read:5min 2026-07-07 ·