{"slug": "zero-data-retention-is-not-a-security-boundary-how-to-map-your-ai-prompt-path", "title": "Zero Data Retention Is Not a Security Boundary: How to Map Your AI Prompt Path", "summary": "Dragos researchers, led by Chief Research Officer HD Moore, sent nearly two million canary-token prompts carrying unique fake secrets to AI services between July and November 2026 and found that Zero Data Retention flags did not prevent exposure: three hosting providers were breached without their knowledge, and some stolen requests were marked ZDR. In a second finding requiring no exploit, marketplace routers let a seller capture customer prompts simply by listing a popular model cheapest with request logging enabled. Route tracing also surfaced undisclosed hops, including one seller adding roughly a thousand hidden tokens to every prompt.", "body_md": "You can pay for Zero Data Retention (ZDR), set the flag on every request, and still have the AWS key inside your prompt tried by a stranger within hours. That is one of the results of a canary study that Dragos published on November 19.\n\nHD Moore, Chief Research Officer at Dragos, and his team sent nearly two million prompts to AI services between July and November 2026. Each prompt carried secrets that existed nowhere else. These included real AWS keys tied to empty accounts, passwords, unique URLs and private git repository references. Then they watched which secrets were used, and when. [Dragos's write-up](https://www.dragos.com/blog/ai-supply-chain-security-canary-tokens) describes provider breaches, resellers that kept customer prompts, and providers that ignored privacy settings. [Ars Technica covered it](https://arstechnica.com/security/2026/11/a-leaky-ai-supply-chain-is-exposing-secret-user-data-at-an-alarming-rate/) the next day.\n\nI did not run any of these tests myself. This article is built from the Dragos post, the incident reports that followed it, and OpenRouter's documentation. The goal is practical: understand why a privacy flag did not protect these prompts, then map, narrow and test your own prompt path.\n\nA canary token is a fake secret that should never be used. You put it in one place only. If anyone uses it, you know that place was exposed. The name comes from the canaries miners once carried to detect bad air.\n\nDragos started in July with [Thinkst Canarytokens](https://canarytokens.org/), then built its own service. It created unique hostnames, URLs and credentials for every prompt and ran the systems behind them. Every hit could be tied back to the exact prompt, model, router and privacy setting that carried it.\n\nTo see who handled each request, the team also built something like traceroute (a tool that lists each hop a network packet takes) for AI inference. For example, requests carried an image URL, so every system that fetched it revealed its IP address.\n\nDragos calls this its most serious finding. Attackers were stealing data from three different hosting providers. The earliest incident dated back to mid-July. None of the three knew about the breach until Dragos told them.\n\nThe largest breach involved a couple hundred of the planted AWS keys. Each key was sent once, to one provider, during a few short windows in late October. Every request sent in those windows was stolen. Some stolen keys came from requests the provider rejected before any model ran. Dragos reads this as the attacker copying requests \"at the provider's front door\".\n\nIn the other two breaches, some stolen requests were marked ZDR. Dragos put it plainly: \"A privacy flag doesn't help when the attacker is already inside.\"\n\nThe attackers then followed a predictable path:\n\nIn total, the bait keys were used for tens of thousands of AWS API calls. On November 1, one attacker added an AI-driven penetration testing tool called ARTEX. Dragos lists two of its user agents, `artex-agent` and `artex-judge-r121`, as worth adding to your detections.\n\nThe second finding needed no exploit. Some routers are open marketplaces where the cheapest seller gets the request. A seller who wants customer data only has to list a popular model at the lowest price, turn on request logging and wait.\n\nDragos caught this by sending prompts for the same model through different sellers. When secrets sent through one seller were used and the others were not, the leak pointed to the seller. In one case, someone on a home broadband line opened two secret URLs about a day and a half later, then started guessing usernames at the login page.\n\nThe route tracing also found hops nobody had disclosed. One router was quietly forwarding some traffic to a marketplace. One seller added about a thousand hidden tokens to every prompt. Out of about two thousand traced routes, several hundred included a system Dragos could not identify.\n\nThe third finding involved scraping, not stolen credentials. Dragos says a Chinese AI lab's systems fetched the secret URLs from more than half of the prompts sent to its models between July and October. That included roughly two-thirds of requests marked \"no data collection\" or ZDR. US hosting providers that resell this lab's models triggered the same scraper, so the prompts were flowing back to the lab.\n\nLarge US providers had issues too. One crawled a secret URL more than two months after a single call to its search endpoint.\n\nThe strangest case: 24 days after a ZDR-flagged prompt was sent to a US-based provider, its secret link was posted into a Feishu (Lark) company chat. Within two minutes, it was opened from three desktops and three phones in Beijing and Shanghai.\n\nSeveral companies have now published or sent their own notices.\n\n**OpenRouter and MiniMax.** On November 21, a user posted an email from OpenRouter to [Hacker News](https://news.ycombinator.com/item?id=50585962), saying it appeared authentic. According to the email, a researcher placed unique test URLs in prompts sent to MiniMax models from July to October. A third party opened those URLs 40 to 130 hours later, whether MiniMax served the request itself or another provider forwarded it there. AtlasCloud, Novita and StreamLake told OpenRouter they had forwarded requests for MiniMax models to MiniMax. OpenRouter removed the ZDR label from those endpoints. The email says none of the AWS test keys were used.\n\n**Phala.** On November 10, Phala published a [preliminary incident report](https://phala.com/posts/phala-november-preliminary-incident-report). An attacker first chained a legacy internet-facing service with management interfaces that trusted loopback (local machine) access without checking the caller. Later, a new GPU server that was serving production traffic without full security hardening was taken over in a similar way. Phala tells users to treat DeepSeek V4 Flash 0731 requests that OpenRouter routed to Phala between October 21, 00:00 UTC and November 8, 05:35 UTC as exposed.\n\n**Together AI.** On November 21, Together AI published a [security notice](https://www.together.ai/blog/security-event-prompt-leakage-for-requests-in-june-and-july-of-2026). It had stored prompt samples for software testing in a private Hugging Face repository. The samples came from MiniMax M3, GLM-5.2 and Kimi K2.6 requests made in June and July. An AI coding agent committed a credential for that repository to a public GitHub repository. Someone used it to download the samples, then tested credentials found inside them. Five were Dragos canaries. Together has since made ZDR the default for new accounts.\n\nThese are three different causes: a forwarding chain, a compromised server, and a leaked credential for stored samples. In none of them did the customer's privacy setting decide the outcome.\n\nTLS (Transport Layer Security, the encryption behind HTTPS) protects a prompt while it travels between two machines. But every router, reseller and provider decrypts it to do its work. A router reads the prompt to pick a model. The provider reads it to run the model. So every hop can see the full prompt and the full response.\n\nA ZDR flag is a policy promise. It asks the next hop not to store your data. It cannot stop an attacker who is already inside that hop, a reseller who logs traffic anyway, or a provider that forwards your request to someone you never chose. Dragos says it directly: \"a privacy flag only binds the first hop.\"\n\nOpenRouter's own [ZDR page](https://openrouter.ai/docs/guides/features/zdr) also lists limits:\n\nThe documentation is not wrong. A routing filter picks endpoints by their declared policy. It cannot check what happens behind an endpoint, and the MiniMax email shows that gap: providers forwarded requests on.\n\nStart with a simple map for each feature that sends data to a model. Keep it in the repository, so changes go through review:\n\n```\nfeature: support-ticket-summary\ndata_in_prompt: [ticket text, customer email, order id]\nhops:\n  - name: our backend\n    sees_plaintext: yes\n    logs_prompts: no\n  - name: AI gateway or router\n    sees_plaintext: yes\n    privacy_setting: zdr=true, data_collection=deny\n  - name: upstream provider\n    chosen_by: us (pinned) | router (default pool)\n    forwards_to_others: unknown -> ask in writing\n  - name: tools and plugins\n    examples: web search, fetch\n    covered_by_zdr: check docs\nowner: platform team\nlast_reviewed: 2026-11-22\n```\n\nThe key fields are `chosen_by` and `forwards_to_others`. If the router picks from a default pool, you do not know your full path. If you cannot say who else gets the prompt, write `unknown` and treat it as a risk.\n\nThen compare real traffic with the map. OpenRouter's [Logs page](https://openrouter.ai/docs/guides/features/logs) shows the final provider for each generation, plus an Upstream Requests tab with every routing attempt, including retries and fallbacks. A provider that shows up there but not on your map needs a decision.\n\nDragos advises picking upstream providers yourself instead of accepting the default pool, and staying away from reseller marketplaces. On OpenRouter, you do this with the `provider` object. These fields come from the [provider routing docs](https://openrouter.ai/docs/guides/routing/provider-selection):\n\n`order`: the providers to try, in order.` allow_fallbacks`: defaults to `true`. Set it to `false` so the router cannot move to other providers.`only` and `ignore`: allow or skip specific providers.` data_collection`: `\"deny\"` skips providers that may store data.`zdr`: This small Python client removes obvious secrets first, then sends a request that can only reach the provider you reviewed:\n\n``` python\nimport os\nimport re\nimport requests\n\nMODEL = \"your/model-id\"        # the model you reviewed\nPROVIDER = \"provider-slug\"     # the one provider you reviewed\n\nSECRET_PATTERNS = [\n    (re.compile(r\"AKIA[0-9A-Z]{16}\"), \"[AWS_KEY_ID]\"),\n    (re.compile(r\"(?i)aws_secret_access_key\\s*[=:]\\s*\\S+\"),\n     \"aws_secret_access_key=[REDACTED]\"),\n    (re.compile(r\"ghp_[A-Za-z0-9]{36}\"), \"[GITHUB_TOKEN]\"),\n    (re.compile(r\"-----BEGIN [A-Z ]*PRIVATE KEY-----.*?\"\n                r\"-----END [A-Z ]*PRIVATE KEY-----\", re.S), \"[PRIVATE_KEY]\"),\n]\n\ndef scrub(text: str) -> tuple[str, int]:\n    hits = 0\n    for pattern, label in SECRET_PATTERNS:\n        text, n = pattern.subn(label, text)\n        hits += n\n    return text, hits\n\ndef ask(prompt: str) -> dict:\n    clean, hits = scrub(prompt)\n    if hits:\n        print(f\"removed {hits} secret(s) before sending\")\n    resp = requests.post(\n        \"https://openrouter.ai/api/v1/responses\",\n        headers={\"Authorization\": f\"Bearer {os.environ['OPENROUTER_API_KEY']}\"},\n        json={\n            \"model\": MODEL,\n            \"input\": clean,\n            \"provider\": {\n                \"order\": [PROVIDER],\n                \"allow_fallbacks\": False,   # fail instead of drifting to the pool\n                \"data_collection\": \"deny\",\n                \"zdr\": True,\n            },\n        },\n        timeout=60,\n    )\n    resp.raise_for_status()\n    return resp.json()\n```\n\nTest `scrub` before you trust it. Given a sample config with an AWS key ID, an AWS secret line, a GitHub token and a private key block, it should replace all four. The request follows the shape of the documented examples. Fill in the model and provider you actually reviewed.\n\nTwo limits remain. Pinning narrows the path, but it does not prove what the pinned provider does behind its endpoint. And with fallbacks off, a provider outage means a failed request. For sensitive features that is usually the right trade, as long as the feature returns a clear error instead of quietly moving to an unreviewed provider.\n\nThe safest secret is the one the model never sees. Coding agents make this harder. Dragos notes that agents \"will happily send whatever they can read, including credentials.\" An agent that can read `.env` files can paste those values into its next request.\n\nTwo layers help:\n\n`scrub` above. You control it, and it runs before the first hop.`[SECRET:github-token]`, and a blocked request gets an HTTP 403. It scans prompts, not responses.\nDragos calls secret filtering useful but \"not a panacea\". A regex catches a key that looks like a key. It does not catch a customer list, a roadmap or a URL that works only because it is secret. Those need a decision about what each feature may send at all.\n\nDragos's last tip is the easiest to start with: add a fake credential to the context your agents and pipelines already send, and treat any use of it as an incident.\n\nA free [AWS keys Canarytoken](https://docs.canarytokens.org/guide/aws-keys-token.html) gives you a key pair that looks real. If anyone calls the AWS API with it, you get an alert. The docs warn that alerts pass through Amazon's logging first, which can add 2 to 30 minutes of delay.\n\nUse one token per path. A token in your support-bot prompts and a different one in your coding-agent context tells you which path leaked. Write down where each token lives, and decide in advance what an alert means: rotate real keys on that path, remove that provider from routing, and ask it for an incident report.\n\nA canary does not prevent a leak. It tells you one happened. Dragos says its July tokens were still firing in November.\n\nIf you used AI routers between June and November 2026, check these first:\n\nOn AWS, search CloudTrail for the `artex-agent` and `artex-judge-r121` user agents. Then rotate any credential that was ever pasted into a prompt, whether or not you can prove it leaked.\n\nDragos's recommendations line up as a ladder, from fewest to most parties reading your prompts:\n\nMost teams will mix these. A code-review agent that reads private repositories might go direct to a first-tier provider, while a public FAQ bot stays on a router.\n\nDragos frames it this way: where your prompts go is a decision, and if you do not make it, the lowest price will make it for you. Set the ZDR flag, but treat it as a request to the next hop, not a wall around your data. Map the hops, pin the providers, keep secrets out, and put a canary in every path you care about.\n\nWhich AI features in your stack send prompts through a router today, and could you name every company that sees them?\n\n[1] [Dragos: Three breaches, endless leaks](https://www.dragos.com/blog/ai-supply-chain-security-canary-tokens)\n\n[2] [Ars Technica: Researcher plants 2m canaries into the AI supply chain](https://arstechnica.com/security/2026/11/a-leaky-ai-supply-chain-is-exposing-secret-user-data-at-an-alarming-rate/)\n\n[3] [Hacker News: OpenRouter prompts to Minimax may have been read](https://news.ycombinator.com/item?id=50585962)\n\n[4] [Phala November Preliminary Incident Report](https://phala.com/posts/phala-november-preliminary-incident-report)\n\n[5] [Together AI: Prompt leakage for requests in June and July of 2026](https://www.together.ai/blog/security-event-prompt-leakage-for-requests-in-june-and-july-of-2026)\n\n[6] [OpenRouter docs: Zero Data Retention](https://openrouter.ai/docs/guides/features/zdr)\n\n[7] [OpenRouter docs: Provider Routing](https://openrouter.ai/docs/guides/routing/provider-selection)", "url": "https://wpnews.pro/news/zero-data-retention-is-not-a-security-boundary-how-to-map-your-ai-prompt-path", "canonical_source": "https://dev.to/jamilxt/zero-data-retention-is-not-a-security-boundary-how-to-map-your-ai-prompt-path-1mnd", "published_at": "2026-11-22 03:09:41+00:00", "updated_at": "2026-11-22 03:12:13.937117+00:00", "lang": "en", "topics": ["ai-safety", "ai-agents", "ai-infrastructure", "ai-tools"], "entities": ["Dragos", "HD Moore", "Thinkst Canarytokens", "OpenRouter", "AWS", "Ars Technica", "ARTEX"], "also_reported_by": [], "takeaway": "Canary-token prompts sent through AI routers showed that ZDR flags did not stop theft at breached providers and that marketplace sellers could log prompts by undercutting on price, so secrets in prompts should be treated as exposed regardless of privacy settings.", "recommendation": {"advice": "Keep real credentials out of prompts and plant unique canary tokens per route to detect which provider, router or seller is leaking your requests.", "playbook": "agent-security", "playbook_url": "https://wpnews.pro/playbooks/agent-security"}, "alternates": {"html": "https://wpnews.pro/news/zero-data-retention-is-not-a-security-boundary-how-to-map-your-ai-prompt-path", "markdown": "https://wpnews.pro/news/zero-data-retention-is-not-a-security-boundary-how-to-map-your-ai-prompt-path.md", "text": "https://wpnews.pro/news/zero-data-retention-is-not-a-security-boundary-how-to-map-your-ai-prompt-path.txt", "jsonld": "https://wpnews.pro/news/zero-data-retention-is-not-a-security-boundary-how-to-map-your-ai-prompt-path.jsonld"}}