DAYJOB: A Benchmark for Long-Horizon Professional Work
Professional work often starts with a brief request that leaves the professional to work out what is needed, which documents matter, and whether the request's premise holds. We introduce DAYJOB, a benchmark of 130 tasks built by professionals in healthcare (50) and finance (80). The tasks are estimated to take a professional 13.6 hours on average in healthcare and 16.6 in finance. Each task is a…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
