ByteDance founder joins AI elite in race to perfect world models
The new model is slated to be launched as soon as October.
ByteDance's founder, Zhang Yiming, is leading the charge in an AI race to develop a groundbreaking model capable of real-time spatial video generation. This model is designed to rival Meta Platforms and Alphabet in a field with significant applications in robotics and autonomous systems. According to sources familiar with the matter, the new model is set for a potential October launch, with Zhang personally overseeing its development and allocating significant AI resources and computing capacity.
The model, built on ByteDance's existing AI model for generating cinematic videos, known as Seedance, aims to enable users to create interactive virtual worlds for live streams, short-form dramas, and games. Zhang hopes this model will propel TikTok creators into the emerging world model arena, joining experts like Fei-Fei Li and Yann LeCun in their pursuit of visual AI crucial for robotics, games, and self-driving cars.
This strategic move marks a shift within ByteDance, as the company focuses more on video production and generation for its business-to-business operations. Both ByteDance and Google are investing in video-centric models to simulate physical environments for AI agents. ByteDance's new model could potentially open a new front in the rivalry with Meta and Apple, both of which have invested heavily in virtual and mixed-reality devices.
Meta's Quest headsets and Apple's Vision Pro have faced challenges in achieving mainstream adoption, and ByteDance's model aims to generate virtual worlds that respond to user voices and movements. By processing spatial content in the cloud, the model seeks to lower the upfront cost of VR adoption, making it more accessible and potentially shifting the battleground for users from hardware specs to AI models, computing infrastructure, and content distribution platforms.
Seedance, ByteDance's signature AI success, powers various ByteDance products, including CapCut and Doubao, China's most popular AI chatbot. Despite ByteDance's lag behind rivals in the domestic AI field, Zhang's latest venture has secured a US$30 billion (S$38 billion) loan to expand its AI capabilities and build data centers and hardware.
Written by urgent.news from Straits Times Business's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.