cua-speedrun: Standardized Benchmarking of the Speed of Computer-Use Agents
Computer use agents (CUAs), which use graphical user interfaces (GUIs) to complete tasks on a computer, have recently surpassed human performance on many standard benchmarks, including difficult long-horizon tasks. Their capabilities are undoubtedly impressive, however, a key barrier to the widespread adoption and deployment of CUAs remains their speed and cost. Progress towards faster yet…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
