# ProbGuard can spot a jailbreak in just ten tokens > Source: > Published: 2026-08-13 18:01:12+00:00 # ProbGuard can spot a jailbreak in just ten tokens ProbGuard flips this by looking at the distributional signals. Instead of reading the text, it analyzes the prefix distribution to estimate the likelihood that the remaining generation will veer into unsafe territory. It basically asks, "Given the tokens I've just started to generate, what is the mathematical probability that this path leads to a safety violation?" To get this right, it uses Monte-Carlo sampling to estimate the risk of the continued generation dynamics. This isn't just a guess; it's a calibrated safety risk estimation. When you look at the numbers, the improvement in calibration is massive. The research shows a reduction in average Brier score by 79.6% and ECE (Expected Calibration Error) by 71.9% compared to the best existing baselines. For those of us interested in the cat-and-mouse game of prompt engineering and LLM security, the most impressive part is the early detection. ProbGuard can limit the attack success rate to under 1% across six different jailbreak attacks after seeing only the first ten decoding steps. This means the system can kill an unsafe response almost the instant it starts, rather than waiting for the "forbidden" word to actually appear. From a deployment perspective, this is a huge win for AI workflow efficiency. If you can stop a hallucination or a jailbroken response at token ten instead of token two hundred, you save significant latency and compute costs. It moves safety from a "post-processing" step to a real-time monitoring process. Since it's architecture-agnostic, this approach could theoretically be layered over any LLM that exposes its logprobs. It turns the model's own uncertainty against the attacker, using the probabilistic "shiver" the model feels before it commits to an unsafe token to trigger the kill switch. [Next Can we actually steal the "hidden" thoughts of a frontier LLM? →](/en/threads/6065/) [an AI side-hustle playbook](https://tanyan888.com/), with plenty of directly applicable cases.