Urgent.News

What's breaking now, across thousands of outlets.

More in AI

How to Build a Good Human-in-the-Loop for Machine Learning

Human in the loop machine learning is the practice of putting human judgment into the machine learning lifecycle itself: labeling and annotating data, choosing which examples are worth a human's time, reviewing the model's low-confidence predictions, and ranking outputs to train the model further.

  • Human judgment integrated throughout machine learning lifecycle
  • Focus on uncertain or informative examples for genuine judgment
  • Three key principles: routing by uncertainty, genuine judgment, avoiding automation bias

More from Saturday 19 September →