K-Bench: a clinically calibrated benchmark for evaluating large language models in high-risk mental health conversations
% !TEX root = ../main.tex People increasingly use large language models (LLMs) for mental health support, yet their safety in evolving, high-risk conversations remains poorly characterised. We developed K-Bench, a clinician-calibrated, protected benchmark evaluating 125 model configurations representing 33 base models from 14 providers across a fixed cohort of 200 multi-turn vignettes involving…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.