FinAutoRubric: Expert-Guided Automatic Rubric Generation for Evaluating Financial Research Agents
Evaluating finance research agents requires rubrics that reflect expert standards and fix the values correct as of an information cutoff. Expert-reviewed finance benchmarks rely on fixed, per-item rubrics, which are costly to extend and cannot encode each institution's own standard. In FinAutoRubric, experts specify reusable evaluation guidance, while agents and code carry out query-specific…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
