cd /news/ai-safety/new-benchmark-evaluation-kavach-vs-r… · home › topics › ai-safety › article
[ARTICLE · art-142318] src=discuss.huggingface.co ↗ pub= topic=ai-safety verified=true sentiment=· neutral

New benchmark evaluation: Kavach vs. real prompt-injection attacks (KavachBench)

An independent researcher's first paper, KavachBench, evaluated Kavach, a policy-enforcement runtime for AI coding agents, against IssueTrojanBench's corpus of 42 malicious tool-call actions drawn from GitHub issue payloads. The researcher reported that Kavach's coverage came from adapter canonicalization under a default-deny policy rather than benchmark-specific policy tuning, a distinction the researcher said matters for anyone evaluating similar guardrails. The researcher is seeking a cs.CR arXiv endorser for the first submission to arXiv.

read1 min views2 publishedSep 30, 2026

Sharing my first research paper as an independent researcher — I evaluated Kavach, a policy-enforcement runtime for AI coding agents, against IssueTrojanBench’s real prompt-injection attack corpus (42 malicious tool-call actions from GitHub issue payloads).

Key finding: coverage comes from adapter canonicalization under a default-deny policy, not from benchmark-specific policy tuning — a distinction that matters for anyone evaluating similar guardrails.

Feedback welcome, and if anyone can point me to a cs.CR arXiv endorser, that’d help a lot — this is my first submission there.

── more in #ai-safety 4 stories · sorted by recency
── more on @kavach 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/new-benchmark-evalua…] indexed:0 read:1min 2026-09-30 · —