{"slug": "let-claude-watch-any-video", "title": "Let Claude watch any video", "summary": "A developer released watchall, an open-source Claude skill that lets Anthropic's Claude watch and analyze video from YouTube, TikTok, Instagram Reels, X/Twitter, Facebook, Vimeo, Twitch, Reddit and 1800+ other sites via yt-dlp, plus every local video format. The skill runs a low-res decode pass for scene cuts, black and frozen frames, builds labelled contact sheets of 12 timestamped frames per image, measures loudness to EBU R128, and transcribes audio through platform captions, Groq, local faster-whisper or OpenAI, then writes a report.md for Claude to answer questions with timestamps. It installs via the Claude Code plugin marketplace or install scripts to ~/.claude/skills/watchall, or as watchall.skill uploaded under claude.ai Settings → Capabilities → Skills.", "body_md": "A Claude skill that lets Claude **see, hear and understand any video**: YouTube, TikTok,\nInstagram Reels, X/Twitter, Facebook, Vimeo, Twitch, Reddit and 1800+ other sites via\nyt-dlp, plus **every local video format** on your computer (mp4, mov, mkv, webm, avi, wmv,\nm2ts, 3gp, ...). Ask for summaries, answers with timestamps, quotes, subtitles - or\n**honest feedback on videos you made**, including AI-generated ones.\n\n```\n/watchall https://www.tiktok.com/@user/video/123  what makes this go viral?\n/watchall my latest video - how can I improve the hook?\n/watchall C:\\Videos\\ad-v3.mp4  check it for AI artifacts\n/watchall https://youtu.be/xyz  summarise in Swedish with timestamps\nURL / file ─► yt-dlp download (or local probe)\n            ─► one low-res decode pass: scene cuts + black frames + frozen frames\n            ─► smart frame picks: strongest cuts first, then fill the largest gaps\n            ─► parallel extraction, near-duplicate removal (perceptual hash)\n            ─► labelled contact sheets (12 frames per image, timestamps burned in)\n            ─► 2 fps \"hook\" sheet for the first 5 s\n            ─► one audio pass: LUFS, true peak, LRA, silences\n            ─► transcript: platform captions → Groq → local faster-whisper → OpenAI\n            ─► technical QA + platform fit + rule-based findings\n            ─► report.md → Claude reads sheets + transcript and answers\n```\n\n|  | watchall | typical video skills | \n|---|---|---|\n| Local videos | any format + **library search** (\"my latest video\") | path only, few formats | \n| Speech-to-text without captions | **free offline faster-whisper** (GPU/CPU), Groq, OpenAI | paid API key needed | \n| Frames per image read | **contact sheets** - 12 timestamped frames per image | 1 frame per read | \n| Duplicate frames | removed (static shots don't waste tokens) | kept | \n| Black / frozen frames, dead air | detected with timestamps | - | \n| Loudness, true peak, clipping | measured (EBU R128) | - | \n| Platform fit (TikTok / Reels / Shorts / YouTube / LinkedIn) | checked | - | \n| Creator + AI-video review rubric | included (hook, pacing, artifacts, prompts) | - | \n| Zoom into a moment | `frame --range 12-15 --fps 6` | re-run whole pipeline | \n| TikTok | works (browser impersonation) | often blocked | \n| Windows | first-class, auto installs ffmpeg via winget | manual | \n| Subtitles out | `.srt` for every video | - | \n| Cache | per video + options, instant follow-ups | re-download | \n\n**Claude Code (plugin):**\n\n```\n/plugin marketplace add admjal/claude-watchall\n/plugin install watchall@watchall\n```\n\n**Claude Code (manual):**\n\n```\ngit clone https://github.com/admjal/claude-watchall\ncd claude-watchall\n./install.ps1        # Windows\n./install.sh         # macOS / Linux\n```\n\nThe installer copies the skill to `~/.claude/skills/watchall` and installs ffmpeg, yt-dlp,\ncurl_cffi, Pillow and faster-whisper.\n\n**claude.ai:** download `watchall.skill` from Releases (or `python tools/build_skill.py`) and\nupload under *Settings → Capabilities → Skills* (code execution must be on).\n\nCheck anytime: `python ~/.claude/skills/watchall/scripts/watchall.py setup`\n\n```\nwatchall.py <url|file> [--start 1:00 --end 1:30] [--res 1280] [--lang sv]\n                       [--max-frames N] [--hook 5] [--no-transcript] [--fresh]\n                       [--cookies-from-browser edge|chrome|firefox]\n                       [--transcriber auto|captions|local|groq|openai] [--whisper-model small]\nwatchall.py frame   <media> --at 12.5 --at 1:03 | --range 10-14 --fps 4\nwatchall.py library [--dir PATH] [--name foo] [--days 7] [--probe] [--json]\nwatchall.py setup   [--install] [--whisper] [--update]\nwatchall.py clean   [--days 7 | --all]\n```\n\nOptional keys in `~/.config/watchall/.env`: `GROQ_API_KEY` (fast, cheap cloud Whisper),\n`OPENAI_API_KEY`, `WATCHALL_WHISPER_MODEL` (tiny/base/small/medium/large-v3).\n\n| Length | Frames | + hook | \n|---|---|---|\n| ≤ 15 s | 24 | 10 @ 2 fps | \n| ≤ 30 s | 30 | 10 | \n| ≤ 1 min | 40 | 10 | \n| ≤ 3 min | 60 | 10 | \n| ≤ 10 min | 80 | 10 | \n| longer | 100 → then use `--start/--end` focus passes |  | \n\n- *Site errors* →`watchall.py setup --update` (sites change; yt-dlp updates fix it).\n- *Instagram / private / age-gated* →`--cookies-from-browser edge` (or chrome/firefox).\n- *No transcript* →`setup --install --whisper` , or set`GROQ_API_KEY` .\n- *Small text unreadable* →`--res 1280` or`frame --at <t> --res 1920` .\n\nOnly analyse content you have the right to access. MIT licensed.", "url": "https://wpnews.pro/news/let-claude-watch-any-video", "canonical_source": "https://github.com/admjal/claude-watchall", "published_at": "2026-10-28 12:15:33+00:00", "updated_at": "2026-10-28 12:42:31.693601+00:00", "lang": "en", "topics": ["ai-tools", "ai-agents", "generative-ai", "developer-tools"], "entities": ["Claude", "Anthropic", "watchall", "yt-dlp", "faster-whisper", "Groq", "OpenAI", "Claude Code"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/let-claude-watch-any-video", "markdown": "https://wpnews.pro/news/let-claude-watch-any-video.md", "text": "https://wpnews.pro/news/let-claude-watch-any-video.txt", "jsonld": "https://wpnews.pro/news/let-claude-watch-any-video.jsonld"}}