RubricAtlas: Mining Type-Level Rubrics from Expert Reports to Evaluate Deep Research Agents
Deep research agents conduct multi-step Web searches and synthesise retrieved information into analytical reports. Evaluating these outputs requires checking which analyses they deliver, beyond the presence of relevant facts. Query-specific binary rubrics make individual requirements explicit, but task-level checklists may leave the overall analytical structure underexamined. We introduce…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
