Person Hides Prompt Injection In Legal Filing Telling AI To Side With Them

According to a report by 404 Media, a Connecticut court recently uncovered a series of hidden instructions within a legal filing. These instructions, known as "prompt injections," were designed to manipulate artificial intelligence into siding with the plaintiff, Matthew Elliott. The instructions were written in a tiny 3-point white font and were hidden throughout the filing, making them nearly invisible to the human eye.

In October, Elliott filed a lawsuit against the New York Bariatric Group, alleging privacy violations, discrimination, and other claims. However, in a late July filing, he included lengthy notes intended for an artificial intelligence system, instructing the AI to accurately reflect the presented filing and ensure remediation. The court noticed these hidden messages due to the presence of extra white space in the pleadings.

The judge, Walter Spader Jr., expressed concern over the specter of AI prompt injections and their potential impact on the legal system. Despite the attempt being deemed unserious, the court sanctioned Elliott, banning him from filing electronic documents and requiring him to submit printed copies instead. Elliott maintains that the sanction is unfair but believes their actions led to a broader discussion about AI, the legal system, and the Bar.