Urgent.News

What's breaking now, across thousands of outlets.

More in Tech

The Number I'll Cite Next Year Won't Come From the Paper

I lost a week in March to a flat reward curve. Not a dramatic failure. Loss went down, reward went up, and the model got quietly worse at the thing I actually cared about. I blamed my data.

  • Lack of reproducibility concerns credibility of RL post-training numbers
  • Independent reproduction proposed as reliable detection method
  • Labs to fund outside runs, make artifacts available for verification

More from Thursday 22 October →