{"slug": "i-statically-scanned-618-public-agent-skills-here-s-what-the-scanner-actually", "title": "I statically scanned 618 public agent skills. Here's what the scanner actually found", "summary": "A developer statically scanned 618 public agent skills sampled across GitHub star ranges and found no intentionally malicious skills, but flagged widespread risky capabilities: 27% involved MCP least privilege, 25% excessive agency, 18% privilege escalation and 16% data exfiltration, with prompt-injection findings in 6.5%. Of 25 CRITICAL findings, 23 came from data-flow hits that turned out to be environment variables sent to fixed first-party API endpoints, and a spot-check of 10 skills found none of the 3 flagged HIGH or CRITICAL warranted that severity. The author cautions that static scanning cannot see runtime behavior and recommends using scores to triage capabilities rather than to judge intent.", "body_md": "**Disclosure:** I ran this study with an AI assistant (Claude), which wrote the scripts, did the analysis and drafted the paper. The assistant also did the manual spot-check described below, so that part is **not** an independent human review. Everything here is aggregate: no skill, author or repo is named.\n\nAgent skills are folders of instructions (a `SKILL.md`) plus optional scripts that coding agents load on demand. The text is read by the model as trusted guidance, and the scripts can run with your permissions. That makes public skill collections a supply-chain surface. So I asked a simple question: **how risky do public skills look to a static scanner?**\n\n`agent-skills`, `claude-skills`, `claude-code-skills`), then drew a seeded, stratified sample across four star ranges (0-9, 10-99, 100-999, 1000+).`--no-llm`). 618 scanned fine; 4 timed out and were excluded.\nThe most common categories were \"MCP least privilege\" (27% of skills), \"excessive agency\" (25%), privilege escalation (18%) and data exfiltration (16%). Prompt-injection findings appeared in 6.5% of skills.\n\nOf the 25 skills with a CRITICAL finding, 23 were CRITICAL only because of \"data flow\" findings, usually an environment variable (like an API key) flowing into an HTTP request. In the ones I read, the destination was a fixed first-party API endpoint. The other two were outdated dependencies pinned in lockfiles.\n\nI also read 10 randomly chosen skills. Of the 3 flagged HIGH or CRITICAL, **none** warranted that severity in my judgment. One \"memory poisoning\" hit was a mocking library's docs saying \"clear call history\". That's 3 skills judged by one non-human reviewer, so treat it as a hint that severity labels over-state risk, not as an error rate.\n\nI did not find a skill I'd call intentionally malicious. That is **not** a claim that none exist: static scanning can't see runtime behaviour, and I didn't estimate how many real problems it misses.\n\nSkillSpector is a static scanner: it lowers risk but doesn't remove it.\n\nUse static scores to **triage capabilities** (network, credentials, subprocess, unpinned dependencies), not to decide who's malicious. Be most careful with skills that ship scripts, and read what a skill does with your credentials before you enable it. Larger, behaviourally validated studies are the right way to find out how common genuinely malicious skills are.\n\nRelated work I found useful (all on arXiv): [Agent Skills in the Wild](https://arxiv.org/abs/2601.10338), [\"Do Not Mention This to the User\"](https://arxiv.org/abs/2602.06547), [Exploring the Emerging Threats of the Agent Skill Ecosystem](https://arxiv.org/abs/2605.28588), [SkillJect](https://arxiv.org/abs/2602.14211).\n\n*Preprint-style write-up, not peer reviewed.*\n\n*By Vyankatesh Rohokale*", "url": "https://wpnews.pro/news/i-statically-scanned-618-public-agent-skills-here-s-what-the-scanner-actually", "canonical_source": "https://dev.to/vyankatesh/i-statically-scanned-618-public-agent-skills-heres-what-the-scanner-actually-found-2ppc", "published_at": "2026-11-20 12:09:47+00:00", "updated_at": "2026-11-20 12:12:35.687060+00:00", "lang": "en", "topics": ["ai-agents", "ai-safety", "ai-tools", "agent-protocols"], "entities": ["GitHub", "Claude", "SkillSpector", "Vyankatesh Rohokale"], "also_reported_by": [], "takeaway": "Static skill scanners over-state severity: 23 of 25 CRITICAL findings were environment variables flowing to fixed first-party API endpoints, so use scores to triage capabilities like network, credentials and subprocess use rather than to judge maliciousness.", "recommendation": {"advice": "Treat public agent skills as a supply-chain surface: read what skills with bundled scripts do with your credentials before enabling them, and triage static findings by capability rather than severity label.", "playbook": "agent-security", "playbook_url": "https://wpnews.pro/playbooks/agent-security"}, "alternates": {"html": "https://wpnews.pro/news/i-statically-scanned-618-public-agent-skills-here-s-what-the-scanner-actually", "markdown": "https://wpnews.pro/news/i-statically-scanned-618-public-agent-skills-here-s-what-the-scanner-actually.md", "text": "https://wpnews.pro/news/i-statically-scanned-618-public-agent-skills-here-s-what-the-scanner-actually.txt", "jsonld": "https://wpnews.pro/news/i-statically-scanned-618-public-agent-skills-here-s-what-the-scanner-actually.jsonld"}}