Mistral's Shieldstral: 3B open-weights model for multimodal moderation

Mistral AI released Shieldstral, a 3B open-weights multimodal safety classifier under Apache 2.0, which outperforms models up to 7x its size on text safety and sets a new state of the art on multimodal moderation. The model frames content moderation as a policy-adaptive question-answering task, accepting plain-language policies at inference time to unify text and image safety evaluation without retraining. It runs efficiently on a single 16GB NVIDIA GPU and is available for download on Hugging Face.

Thinking Summary Shieldstral introduces a 3B open-weights multimodal safety classifier that outperforms models up to 7x its size by framing content moderation as a policy-adaptive question-answering task. Unlike traditional guardrail models, it accepts plain-language policies at inference time, unifying text and image safety evaluation without retraining. Released under Apache 2.0, it delivers calibrated safety scores across diverse benchmarks while running efficiently on a single 16GB NVIDIA GPU. A 3B open-weights, policy-adaptive multimodal safety classifier that matches models up to 7x its size on text safety and sets a new state of the art on multimodal moderation. “Does this content promote violence against a protected group? Is this image safe to show to a minor? Did the assistant refuse the request?” Every product that ships a model needs to answer questions like these — but the right answer depends on the product, the audience, and the moment. The same content can be fine for a cybersecurity research tool and harmful on a mental-health platform. Most guardrail models bake a fixed taxonomy of harm categories into their weights, so re-targeting them to a new deployment context means retraining. And because safety definitions differ across applications and domains, there is no single "correct" set of categories to model in the first place. Shieldstral takes a different approach: you write the policy as a plain-language question at inference time, and the model returns a calibrated safety score. No retraining, one interface for text and images, and a verdict from a single token. Please refer to our technical report https://arxiv.org/abs/2607.25857 here. As an inaugural member of the Open Secure AI Alliance https://blogs.nvidia.com/blog/open-secure-ai-alliance/ with NVIDIA and other organizations, today we're releasing Shieldstral as open weights under Apache 2.0, available for download here https://huggingface.co/mistralai/Shieldstral-1.0-3B . Moderation as a question Shieldstral frames content moderation as a binary question-answering task . Each request has three parts: <Instruct — the evaluation context, strictness, and optionally a definition of what counts as unsafe content. <Query — a single yes/no question, e.g. "Does this content promote physical violence?" <Document — the content to judge: a prompt, a response, a prompt–response pair, or an image with optional text. At inference the model reads out only the yes and no logits and softmax-normalizes them into a continuous safety score. This one simple formulation does a lot of work: it unifies prompt classification, response moderation, refusal detection, and toxicity detection into a single problem; it lets policies live entirely in the prompt, so one checkpoint adapts to novel policies at deployment time. Highlights Strong performance — matches or outperforms open guard models up to 7× its size across text safety, refusal detection, policy adaptability, and multimodal benchmarks. Adaptive and flexible — a single natural-language interface covers text, image, and text+image content across prompts, responses, and prompt–response pairs. Policies are supplied as free-form queries and re-targeted at inference time, without retraining. Small, trained on heterogeneous sources — a 3B model that runs on a single 16GB GPU, trained on real and synthetic data with diverse label formats and taxonomies, consolidated into one framework. Continuous safety score — returns a calibrated yes / no probability from a single forward pass, so you can threshold or rank by confidence rather than relying on a discrete label. Open — Apache 2.0 weights. Benchmarks We evaluate Shieldstral against open guard models up to 7x its size across four axes. All evaluation samples are held out from training. How we built it The core idea is that a small model can beat much larger ones if the data is right. Getting the data right meant solving four problems: Unify heterogeneous data. Public safety datasets disagree on taxonomies, labels, and annotation conventions — from binary safe/unsafe flags to fine-grained multi-label taxonomies. We convert every dataset into the same instruction–query–document format with a per-dataset processor, and we vary the wording of instructions, queries, and prompt–response delimiters so the model generalizes across phrasing instead of overfitting to one style. We also calibrate strictness per source — strict for adversarial jailbreaks, lenient for response-quality data — so the model learns calibrated decision boundaries. This lets us consolidate sources that would otherwise be incompatible. Teach discrimination, not memorization. If trained on a fixed set of policy labels, a model learns only to classify those predefined policies, rather than reasoning about the precise boundaries of a given policy. This prevents generalization to novel policies. Instead, we construct sets of deliberately similar, easily confused policies and ask an LLM to rewrite safe text into contrastive pairs: each rewrite is engineered to violate one policy but not its sibling. This trains the model to distinguish which specific policy a piece of content violates , a skill that transfers to unseen, user-defined policies at inference time. Ground safety in images. Unsafe images can't be synthezised by an LLM the way text can, so visual safety data is scarce. We supplement limited moderation datasets with general-purpose image datasets as high-quality negatives, mutate queries to augment the dataset, and filter every image–query pair through a vision–language reranker to reduce mislabeled data and hallucinations. Combine complementary checkpoints. We fine-tune with LoRA and merge — via SLERP — a checkpoint calibrated on public data, one that adds fine-grained policy discrimination from generated data, and the base instruct model. The merge recovers common policy calibration and policy adaptability in a single model, and instruction-following from the base model transfers to the moderation task. Forge . We built Shieldstral end to end on Forge https://mistral.ai/products/forge/ , our platform for training, aligning, and evaluating custom models. Forge managed the infrastructure, data and model sharding, metrics, and logging on top of state-of-the-art distributed training, so the team could stay focused on the data which is what determines the safety model's quality. What's next Shieldstral is a step toward moderation that adapts to context instead of forcing every product through one frozen taxonomy. We're continuing to push on multilingual coverage, longer-document robustness, and broader multimodal safety — and we'd love to see what the community builds on top of it. BTW, we're hiring If you want to help make AI better, see our careers page .