Urgent.News

What's breaking now, across thousands of outlets.

Editions

AI

Nvidia just showed that the harness, not the AI model, is now the real hero

Nvidia research shows that AI agents can perform well, and not go off the deep end, through fine-tuning, even if the AI model isn't that great at the task.

Nvidia's recent research highlights that the "harness" - the set of tools and components that provide memory, context, and feedback to an AI model - plays a more crucial role than the underlying model itself in handling long-horizon tasks. By optimizing a custom harness and introducing a "supervisor" component, Nvidia's Claude Opus 5 achieved a perfect score of 100% on the challenging interactive reasoning benchmark ARC-AGI-3, while previously only scoring 30%.

This indicates that while model choice is significant, the harness contributes even more to an AI's ability to perform complex tasks across multiple decisions. The "harness" is not just the model but also the scaffolding, runtime, and associated skills and libraries that the model utilizes. It is a key factor in transforming an AI into an agent capable of long-term decision-making.

Nvidia's research emphasizes the importance of open harnesses, which allow users to fine-tune various aspects and significantly improve AI performance and efficiency.

Written by urgent.news from TechCrunch's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

Read the original at techcrunch.com →

More in AI

AI Boosted Homework Scores, Then Exam Scores Dropped

An anonymous reader quotes a report from The Economist: Students and school children are increasingly using artificial intelligence.

  • AI usage by 80% of Chinese students aged 12-18
  • Homework scores increased by 18% with AI assistance
  • Exam scores dropped by 20% with AI usage

More from Friday 21 August →