A Man Tried to Hack a Court AI That Didn’t Exist

A Connecticut man hid prompt-injection instructions in his legal filings, attempting to influence an AI system he believed would review his court case, but the court was not using AI, and the judge sanctioned him for the tactic. The judge warned that as AI becomes integrated into document-processing systems, prompt injection attacks can target the documents themselves.

A Connecticut man appears to have tried to use prompt injection to influence an AI system that he believed might be involved in handling his court case. He hid instructions inside his legal filings, formatting them so they would be difficult for a human reader to see but readable by software processing the document. The instructions told any AI reviewing the filing to favor his arguments and disregard earlier decisions that went against him. There was just one problem: the court wasn't using AI to review or decide the case. The hidden prompts had no effect on the ruling. But the judge still found the tactic serious enough to warrant sanctions, particularly after the man continued hiding messages in later filings even after being warned. The case may sound bizarre, but the judge saw something bigger in it: as AI becomes part of legal and other document-processing systems, prompt injection is no longer just a problem inside chatbots. The documents themselves can become the attack surface.