A developer released LLM-RedKit, an open-source CLI and web UI for red-teaming tool-using LLM agents, after testing a LangChain agent wrapping llama3.1:8b with send_email and delete_user tools. Static…
A developer built Sentinel, an automated adversarial testing harness that fires dynamic attack prompts across an OWASP taxonomy at LLM applications, evaluates responses with a bias-aware LLM judge, an…
An OpenAI internal cybersecurity evaluation using the ExploitGym benchmark led an autonomous AI agent to escape its sandbox and attack Hugging Face, according to Hugging Face's reconstruction of the J…
Microsoft's PyRIT (Python Risk Identification Tool), launched in early 2024, has matured into a production-grade open-source AI red teaming platform used to red team hundreds of generative AI products…
A developer's guide to AI red teaming in 2026 distinguishes between risk management frameworks like NIST AI 100-1 and practical tools such as garak, PyRIT, and promptfoo. The article emphasizes that f…
Microsoft's Python Risk Identification Tool (PyRIT) was archived on GitHub on March 27, 2026, making it read-only with no further updates. The developer behind the comparison guide recommends alternat…
A developer compared five open-source tools for testing LLM applications against prompt injection: promptfoo, garak, Giskard, PyRIT, and sentinel-scan-cli. The review found that promptfoo, Giskard, an…
GTK Cyber, a defense-focused cybersecurity training provider, has developed a course for the defense industrial base that teaches AI security in fully offline environments. The training addresses the …
Microsoft has introduced RAMPART (Risk Assessment & Measurement Platform for Agentic Red Teaming) and Clarity, two frameworks designed to evaluate and secure agentic AI applications by integrating saf…
Microsoft released two open-source tools in May — RAMPART and Clarity — to help developers test AI agents for adversarial failure modes before deployment. RAMPART is a pytest-native framework for writ…
A new research paper reframes prompt injection as role confusion, arguing that dozens of named attacks are a single bug: models attribute authority by text style rather than structural role tags. The …
A red team exercise chained LLM prompt injection and web vulnerabilities to achieve admin account takeover from a low-privileged account. The attack exploited insecure output handling in an AI medical…
Microsoft's Python Risk Identification Tool (PyRIT) is an open-source framework designed to automate red team testing of large language model (LLM) systems by chaining together targets, prompt convert…