Can Jev Judge Radiology Reports? Evaluating a System One Model for Clinical Factuality
An AI-generated radiology report can resemble a physician's report while omitting an abnormality, adding an unsupported finding, or reversing its presence. Measuring these factual differences is essential for evaluating report generators. We study Jev, a System One decision model, as a simple, low-cost judge of agreement with physician-written reference reports. Our evaluator checks whether each…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
