Matrix in a word
Peirce quincuncial projection SW 20W tiles - Peirce quincuncial projection - Wikipedia
This world is yours
“Something that would define a world model is the degree of freedom that you have in interacting with the spatial world, where you do not have this mediated linear journey of A then B then A then B then A then B,” he said. When a user or agent is utilizing a world model, they are “actually able to interact with it like it is some sort of world and you are taking continuous actions” where “there are parallel things happening at the same time.”
Mildenhall’s co-founder Fei-Fei Li has written that she believes there are three criteria that define a world model: World models “can generate worlds with perceptual, geometrical, and physical consistency,” “are multimodal by design,” and “can output the next states based on input actions.”
The phrase itself is not new; it has long appeared in reinforcement learning and robotics to describe models that predict environment dynamics. What is new is the attempt to scale that idea into general-purpose, generative systems trained on massive visual and multimodal data. The huge funding rounds are relatively new, too.
The truth is that there are numerous approaches and definitions. “Ask Runway, ask us, ask whoever—we’re all gonna give you a little bit of a different term,” Mildenhall said.
No comments:
Post a Comment