Gym-Anything-RT: Scaling Real-Time Environments for Vision-Language Agents
AI agents have made substantial progress in domains where they have a non-trivial amount of time to deliberate between actions, such as mathematics, software engineering, and performing tasks on desktop applications. It is less clear how such models fare in settings that demand real-time interaction, such as playing a video game or operating a physical device. In these settings, the environment…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
