Urgent.News

the world's headlines, one feed

Editions

More in AI

What We Check Before Shipping an LLM Integration to a Client

When we hand off an LLM-powered feature to a client, they are putting it in front of their users. Some of those users will try to break it — not always maliciously, but because users probe things.

  • Test system prompt for extractability by generating probes
  • Test for instruction override with injection probes
  • Examine data exposure by securing sensitive information