CUA-Universe: A Scalable and Dynamic Environment for Hybrid GUI+CLI Agents
Computer-use agents have advanced on benchmarks like OSWorld and AndroidWorld, but still act mostly through the GUI, often producing inefficient trajectories. Real-world computer work is hybrid, combining visual-state inspection with precise, high-throughput command-line operations, so capable agents must coordinate both modalities over shared application state. Yet scalable hybrid environments…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.