Inducing Task Models from Computer-Use Traces
Naturalistic computer-use traces, passively recorded screenshots and mouse or keyboard actions, are a valuable resource for deriving symbolic, auditable, and reusable models of how everyday work is done. Such models matter as computer-use agents enter real work, where agents need to learn how tasks are actually performed, and organizations need to audit and reuse that knowledge. However, inducing…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.