Profiling a Frontier Agent with EBench: From Direct Control to Harness with Policy
Frontier multimodal large language models (MLLMs) can control robots without robot-specific training, but how their capabilities compare and interact with post-trained vision-language-action (VLA) and world action model (WAM) policies across manipulation demands remains to be thoroughly evaluated. In this report, we evaluate GPT-6-Astra on EBench as the core of an agent that controls a robot…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
