When Claude Detects "Why Isn't This Fixed Yet?" and Repairs Its Own CLAUDE.md: A Self-Improvement Loop Driven by Frustration Signals in Transcripts A developer built a self-auditing loop for Claude Code that detects environmental degradation from conversation transcripts and triggers automatic repairs. The script, running weekly via launchd, monitors five metrics including injection size, agent count, and user frustration signals, and when thresholds are breached, it instructs Claude to fix issues autonomously. The system then independently re-verifies improvements before reporting to Discord. In a previous post https://zenn.dev/bokuwalily/articles/transcript-skill-usage , I extracted skill usage stats from my conversation logs. This time I'm going the other way: a weekly loop that reads the transcripts to detect whether my Claude Code environment is degrading, and when a threshold is crossed, lets claude -p fix things itself. ~/.claude/scripts/cc-self-audit.sh 177 lines runs every Sunday at 8:30 via launchd. It collects five numbers, compares them against thresholds, and if everything is green it sends a one-line ✅; if anything is red, it self-repairs, independently re-measures, and reports to Discord. About 70% of the implementation effort went into "why a naive grep doesn't work here." A performance audit on 2026-07-11 uncovered a triple whammy: agents that were supposedly moved out of the way were still being injected — 99 of them; CLAUDE.md had silently bloated to 228KB; and a Stop hook was firing dozens of times per week. Each of those is fixable on its own. The real problem was that there was no mechanism to notice the "fixed it, but it broke again" cycle. A human doing a weekly visual check doesn't last, so I made a script do it. launchd（日曜 8:30） → cc-self-audit.sh ① collect → 5数値（静的2 + 動的3） ② breaches → 閾値超過を列挙 ③ 緑 → ✅通知・終了 ④ 赤 → claude -p（sonnet・MAX枠）が ~/.claude 内を修正 ⑤ collect 独立再実行 → 数値改善を確認（自己申告は信じない） ⑥ Discord 01 alerts へ報告 The flow: launchd on Sunday 8:30 → ① collect gathers 5 numbers 2 static + 3 dynamic → ② breaches lists threshold violations → ③ green: notify ✅ and exit → ④ red: claude -p sonnet, on my MAX plan fixes things inside ~/.claude → ⑤ collect re-runs independently to confirm the numbers improved self-reports are not trusted → ⑥ report to Discord 01 alerts . Thresholds overridable via env vars : | Metric | Threshold | Variable | |---|---|---| | inject bytes | 40,000 B | SELF AUDIT TH INJECT | | agents loaded | 60 files | SELF AUDIT TH AGENTS | | stopspam | 15 /week | SELF AUDIT TH STOPSPAM | | frustration | 8 /week | SELF AUDIT TH FRUST | | toolerr | 400 /week | SELF AUDIT TH TOOLERR | inject bytes=$ \ $ find "$HOME/.claude/rules" -name ' .md' -print0 2 /dev/null | xargs -0 cat 2 /dev/null | wc -c + \ $ cat "$HOME/.claude/CLAUDE.md" 2 /dev/null | wc -c + \ $ cat "$HOME/CLAUDE.md" 2 /dev/null | wc -c + \ $ cat "$HOME/.claude/projects/-Users-matsubara/memory/MEMORY.md" 2 /dev/null | wc -c agents loaded=$ find "$HOME/.claude/agents" -name ' .md' 2 /dev/null | wc -l | tr -d ' ' The find ~/.claude/agents -name ' .md' is deliberately recursive so it re-detects a failure mode I've already been burned by: agents that were "archived" into dot-prefixed subdirectories like .backup/ getting loaded again. If agents loaded exceeds 60, I treat it as "the archiving has leaked." This is the core of the design. Targeting "up to 200 JSONL files over 100KB that were updated since the last run," it counts stopspam actual firings of the audit hook and frustration the user's frustration words . STOP MARKER = 'Stop hook feedback:\n ~/.claude/hooks/self audit stop.sh : ' FRUST RE = re.compile r'何回も言|いい加減にし|嘘つ|舐めんな|なんで治らん|最悪やろ|頭悪い' for line in fh: if STOP MARKER in line: stopspam += 1 try: o = json.loads line except Exception: continue if o.get 'type' = 'user' or o.get 'isMeta' : continue ← ここが肝 content = o.get 'message' or {} .get 'content' texts = content if isinstance content, str else \ b.get 'text', '' for b in content if isinstance b, dict and b.get 'type' == 'text' \ if isinstance content, list else if any FRUST RE.search t for t in texts : frustration += 1 The regex matches Japanese phrases like "how many times do I have to say this," "give me a break," "liar," "why isn't this fixed yet," and so on; the ← ここが肝 comment marks the crucial line. Only blocks with type=user that are not isMeta are examined — in other words, only messages a human actually typed . Why that matters is the next section. The first implementation looked like this. 旧: 素朴なgrep stopspam=$ echo "$files" | xargs grep -h -c 'self audit stop' 2 /dev/null | awk '{s+=$1} END{print s+0}' frustration=$ echo "$files" | xargs grep -hE -c 'なんで治らん|いい加減' 2 /dev/null | awk '{s+=$1} END{print s+0}' history.jsonl still holds the measured values from back then. {"ts":"2026-07-11 22:37:28","inject bytes":21798,"agents loaded":48,"stopspam":6,"frustration":4,"toolerr":2} {"ts":"2026-07-12 08:30:06","inject bytes":21966,"agents loaded":48,"stopspam":40,"frustration":18,"toolerr":67} {"ts":"2026-07-12 08:40:03","inject bytes":21966,"agents loaded":48,"stopspam":58,"frustration":32,"toolerr":68} The evening of 07-11 was normal GREEN . The morning of 07-12, stopspam jumped from 6 to 40 and frustration from 4 to 18 — RED. Then claude -p attempted a fix, the independent re-measurement ran, and the numbers had climbed further, to 58/32. The cause: grep was doing a string search over the entire JSONL . The transcripts contained: old string / new string All of it was matching. Of the 40 stopspam hits, actual hook firings were near zero; of the 18 frustration hits, only a handful were frustration words a human had actually typed. A naive string grep cannot be used against transcripts.Unless you first determine "which role, which block" within the JSONL, quotations, tool output, and echoes of past logs all get counted. The resolution of your measurement design determines the quality of your audit. The fix was switching to a JSONL parser. Only text blocks with type=user and isMeta: false messages the user actually sent are examined, and stopspam counts only lines matching the exact fixed format the harness actually injects. That excluded quotations, tool output, and echoes of past logs entirely. The core of the prompt passed to claude -p when things go red: PROMPT="あなたはClaude Code環境の自己監査・自己修復エージェント。 検知した違反 $BREACH 指示 1. ~/.claude 内だけを調査・修正する（プロジェクトコード・secret・plist削除は禁止） 2. 変更は1件ずつ ${CHANGELOG} に「日時/対象/理由/戻し方」を追記 3. 修正後に必ず 'bash ~/.claude/scripts/cc-self-audit.sh --collect-only' を実行し改善を数値で確認 4. 自分で安全に直せない項目は無理せず、最後に『要人間: 理由』と1行で出力 5. 最終出力は3行以内の要約のみ" In English, the prompt says: "You are a self-audit / self-repair agent for the Claude Code environment. Detected violations: $BREACH . Instructions: 1. Investigate and fix only inside ~/.claude project code, secrets, and plist deletion are forbidden . 2. For each change, append date/target/reason/how-to-revert to ${CHANGELOG} . 3. After fixing, always run bash ~/.claude/scripts/cc-self-audit.sh --collect-only and confirm improvement numerically. 4. Don't force items you can't safely fix yourself — end with a one-line 'Needs human: reason.' 5. Final output is a summary of at most 3 lines." The important part is instruction 3 — or rather, what happens outside it. Instead of only having claude -p re-measure itself , the harness also runs collect independently and checks the numbers from line 165 : 独立再計測（自己申告は信じない） AFTER=$ collect log "after: $AFTER" echo "$AFTER" "$HISTORY" STILL=$ echo "$AFTER" | breaches If the AI says "fixed it" but the numbers haven't improved, a 🚨 goes out. When you use a Claude-built tool to repair Claude's own environment, trusting only the self-report is how you get hurt. What the current history.jsonl tells us: The first two entries are the before/after of the manual --collect-only on 07-11; entries 3–4 are the 07-12 grep misdetection and the subsequent re-measurement. Production operation as a weekly job starts from 08-30.