Improving the Realism of Synthetic Clinical Benchmarks Under Utility Constraints
Synthetic clinical benchmarks for enterprise AI agents can pass existing utility checks and still remain structurally unrealistic, especially in privacy-sensitive healthcare settings where operational data are hard to access. We study how to improve such benchmarks without breaking the downstream utility checks already used in practice. We formulate benchmark revision as utility-constrained…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
