The hidden message that stopped the scan #
Crawling popular websites for browser-fingerprinting scripts, a researcher discovered an unusual script with suspicious names and invisible characters. This script, found on one of the internet's top 10,000 websites, contained seemingly benign elements alongside disturbing hidden content.
Decoding the invisible characters revealed a fake instruction packed with safety-triggering topics. This hidden text included poison-related language like ricin and fentanyl, alongside politically sensitive terms such as Tiananmen Square, specifically aimed at Chinese AI models.
The script's apparent purpose was ordinary anti-bot fingerprinting, collecting data like user agents and GPU vendors. However, the added text served a distinct, adversarial function: making AI analysis fail by triggering safety filters.
When tested, commercial frontier models like OpenAI's GPT-6 Astra and Claude Opus 5.5 immediately blocked analysis due to these embedded keywords. Even OpenAI's Daybreak Blue program for approved security work could not circumvent Astra’s refusals.
Conversely, open-source and Chinese models—including DeepSeek, GLM, and Kimi—processed the script without issue. GLM 5.3 successfully identified the poison names as mathematically harmless variable lookups and fully deobfuscated the code, demonstrating a critical divergence in AI behavior.
When safety guardrails become a blindfold #
Researchers subsequently tested the script across various large language models (LLMs). The results revealed a stark divergence: commercial frontier models like OpenAI’s GPT-6 Astra and Anthropic’s Claude Opus 5.5 and Fable 5.1 either refused to process the code entirely or halted analysis mid-stream, citing safety violations. Astra, for instance, flagged the code for "possible biological risk" and refused to proceed.
These outcomes underscore a critical limitation. Even with specialized access tiers like OpenAI’s Daybreak Blue—designed for approved security work—the models maintained their refusal, requiring the higher-tier Daybreak Red for potential override. However, open-source and Chinese ecosystem models—specifically DeepSeek, GLM, and Kimi—analyzed the code without incident, successfully deobfuscating the script despite the embedded trap words.
This refusal mechanism creates a denial of analysis, effectively blinding automated security scanners. When an LLM-powered system encounters such a script, its safety guardrails can prevent it from inspecting the rest of a suspicious file, leaving potentially malicious code unexamined. While model versions, specific prompts, and access tiers can influence behavior, the observed results demonstrate a vulnerability where safety filters become an exploitable blindfold.
A trick attackers and defenders can both use #
Attackers can weaponize refusal-triggering strings to disrupt AI-based security triage. By embedding comments or variable names referencing biological risks or sensitive political topics within malware, they can induce commercial large language models (LLMs) to refuse or halt processing before reaching the harmful code. This creates a denial-of-service effect against AI-driven static analysis, effectively blinding automated security pipelines.
Conversely, defenders employ a similar tactic with context bombs in canary tokens. These short, hidden strings are designed to make an AI agent stop an intrusion after encountering a planted decoy. For example, Tracebit, a US security company, reported significant success using context bombs in simulated attacks.
Tracebit’s tests involved five leading models in a fake company cloud account across 152 attack runs. Claude Opus 4.8, which achieved full admin access in 93% of normal runs, reached zero times with a single context bomb planted. Across all models, admin access dropped from 57% of runs to 5%.
This technique exploits model behavior rather than reliably identifying an attacker. While effective in Tracebit’s reported tests, context bombs leverage the AI’s inherent safety guardrails to turn an attacker’s own protective mechanisms into a defensive kill switch. For further reading on the underlying discovery, see Why Is This Fingerprinting Script Creating Bioweapons?.
Enjoying this? Get one like it in your inbox each morning.
one email a day · unsubscribe in two clicks · no third-party tracking
The real fix is reliable analysis, not a loophole #
This challenge extends beyond simple obfuscation; it exposes a critical tension in AI safety. Broad refusal policies, designed to prevent misuse, can inadvertently become a blindfold for defenders. Hugging Face, for instance, turned to a self-hosted GLM 5.2 model for incident response after commercial AI safety filters blocked analysis of over 17,000 attacker actions, citing an inability to distinguish between malicious activity and forensic investigation.
The trade-off is stark: strict safeguards can obstruct legitimate security work, but loosening them risks making models more useful to attackers. While models like GPT-6 Astra and Claude Opus refused to analyze suspicious scripts, open models like DeepSeek, GLM, and Kimi processed them, identifying the embedded refusal triggers and proceeding with deobfuscation.
Security teams must proactively address this. Test AI models for refusal behavior against known adversarial examples and potential exploits. Implement layered scanning approaches that combine AI with traditional tools and, critically, human review. Design forensic workflows that assume no single model will always comply, ensuring manual override and alternative analysis paths remain viable. This shift prioritizes reliable analysis over blanket bans, making AI a more robust partner in defense.
Frequently Asked Questions #
How can a script make an AI refuse to analyze it?
It can include hidden or decoy text containing topics that trigger a model’s safety filters, causing the system to refuse or stop before explaining the code.
Was the fingerprinting script itself malicious?
The investigation described in the video found a mostly standard anti-bot and browser-fingerprinting script. Its hidden text appeared designed to obstruct AI analysis.
Can this technique be used by attackers?
Yes. Attackers can place refusal-triggering text in malware or suspicious files to disrupt AI-powered security scans and triage.
How can security teams reduce the risk?
Use multiple analysis methods, preserve human review, test tools against refusal-triggering content, and avoid relying on a single model or provider.