Urgent.News

600+ sources. One page. See who else covered it.

Editions

More in Tech

0.3% In, 36% Out: Your Fine-Tuned Model Is Copying Your Prompt Examples

I run a fine-tuned Llama 3.3 70B on Amazon Bedrock. It generates short first-person narrative posts: a setup, a few lines of story, and a closing line that lands the point.

  • Fine-tuned Llama 3.3 70B model copied prompt examples
  • 36% of generated posts ended with identical closing lines
  • Diversifying prompt examples fixed the issue

More from Thursday 13 August →