How Well Do LLMs Perform in Peer Review? Evidence from Finance and Accounting
Referees increasingly use large language models (LLMs), while finance and accounting journals disagree about whether to allow it. We ask which part of a referee's job the models can do. GPT-4o, whose training data end before the 2024 conference season, referees the papers presented at the 2024 AFA and NBER finance meetings, and we compare its verdicts with publication in the top-three finance…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.