Urgent.News

What's breaking now, across thousands of outlets.

AI

Researcher plants 2m canaries into the AI supply chain. A privacy disaster surfaced.

Test using prompts with unique, trackable secrets proves that data doesn't stay private.

Researcher plants 2m canaries into the AI supply chain. A privacy disaster surfaced.

Two million digital "canaries" were inserted into AI service requests by a researcher to uncover the fate of sensitive information entrusted to these platforms. The experiment aimed to test whether sensitive data could leak through the extensive network of widely used AI services and how such information is exploited once leaked.

The AI services commonly employed by today's AI applications include OpenRouter and Vercel, which function as brokers that route numerous prompts to suitable inference engines based on factors like cost or suitability. Instead of directly utilizing providers like Anthropic or OpenAI, developers opt to hire AI routers to identify the most appropriate model.

This setup exposes potential security breaches, prompt theft, and privacy violations. To detect possible leakage, researcher HD Moore gathered AWS access keys, unused credentials linked to empty AWS accounts, SSH passwords, and unique URLs, DNS names, and private git repository references. These secrets had not been utilized before, and the researcher controlled the infrastructure that received requests using the credentials.

By seeding each secret into a single prompt sent to an individual provider, Moore could identify the responsible link in the chain should any of the secrets be leaked. The researcher effectively employed "canaries" to mimic the role of a bird used in coal mines to alert miners of toxic gases, enabling him to pinpoint the source of any security breaches.

Written by urgent.news from Ars Technica's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

Read the original at arstechnica.com →

More in AI

Miami coach Mario Cristobal updates Malachi Toney's recovery, eyes possible return within 2 weeks

5 Miami could have star receiver Malachi Toney back from his surgically repaired high ankle sprain within two weeks, Hurricanes coach Mario Cristobal said Friday.That timetable — if it holds up…

  • Star receiver Malachi Toney may return in two weeks from high ankle sprain.
  • Coach Mario Cristobal optimistic about Toney's recovery progress.
  • Toney's return could enable Miami to play in ACC championship on Dec 5th.

More from Friday 20 November →