Microsoft released two open-source tools, RAMPART and Clarity, in May to help developers test AI agents for adversarial failure modes before deployment. RAMPART is a pytest-native framework for writin…
A new research paper reframes prompt injection as role confusion, arguing that dozens of named attacks are a single bug: models attribute authority by text style rather than structural role tags. The …
A red team exercise chained LLM prompt injection and web vulnerabilities to achieve admin account takeover from a low-privileged account. The attack exploited insecure output handling in an AI medical…
Microsoft's Python Risk Identification Tool (PyRIT) is an open-source framework designed to automate red team testing of large language model (LLM) systems by chaining together targets, prompt convert…