Vision-Language Agents Can Learn in Their Own Latent Worlds
Learning from experience is essential for building the next generation of agents that continually expand their capabilities. Pretrained vision-language models (VLMs) already internalize rich world knowledge, yet this knowledge is rarely leveraged to drive policy improvement through online interaction. Realizing this potential efficiently remains challenging, as policy updates shift the agent's…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
