Urgent.News

What's breaking now, across thousands of outlets.

AI

We ran our own note checker against a public scribe benchmark. Here is what it missed.

Krasyn ships a tool called Note Check. Paste a visit transcript and the note any AI scribe drafted from it, and it labels each sentence Supported, Unsupported, Contradicted, Scaffolding or Unverified against the transcript, raises three pure-code flags (a number the transcript never contained, a denial about a topic raised and never denied, content filled over an inaudible marker) and lists the…

Krasyn's Note Check tool analyzes AI-generated clinical notes against a transcript. It labels each sentence as Supported, Unsupported, Contradicted, Scaffolding, or Unverified, and identifies three types of code flags. The clinician signs the note without edits. The results are published without accuracy figures as it hasn't been measured against a clinician-adjudicated reference set. This article presents the first findings using open data that was already labeled.

Written by urgent.news from Dev.to's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

Read the original at dev.to →

More in AI

More from Friday 21 August →