No PUN Intended: Plausible Unknown Names for Person-Centred LLM Evaluation
Person names are widely used as prompt variables in LLM evaluations of factuality, privacy leakage, bias and abstention, but when a name's evidential status is uncontrolled, measurements may conflate memorisation, retrieval, name priors and wrong-person attribution. We operationalise an unknown name as one with plausible First-Last form, no indexed full-name evidence, and no ambiguity signals…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
