InsufficiencyBench: Evaluating LLM legal advice on underspecified user queries
Legal AI systems are increasingly used to answer legal questions, yet existing benchmarks assume queries arrive fully specified. In practice, users omit facts that materially determine the legal outcome. We introduce InsufficiencyBench, the first legal benchmark targeting query-side insufficiency: whether a model recognizes when a query lacks legally material information, identifies what is…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
