It’s 2016, and you’re wandering around the neighborhood at dusk. On the prowl, you’re swiping on a smartphone to catch that elusive Snorlax and grow your collection in Pokémon Go. You, alongside hundreds of millions of other players, are enjoying a mixed-reality game built around lovable characters. What you don’t realize is that these scans of your environment will one day help robots navigate obstacles and interact with objects.

Niantic, the creator of Pokémon Go, sold the game last year and pivoted hard into one of Silicon Valley’s buzziest AI topics right now: world models. “We’re very much about reconstructing the real world,” says Brian McClendon, Niantic Spatial’s chief technology officer. He hopes to leverage its trove of world data to build replicas. Unlike the text-based nature of large language models, world models use visual inputs and can generate digital environments that simulate physics.

This software is poised to seep into everyday life, without you necessarily ever interacting directly with world models. 2027 could be a major year for the expansion of home robotics and driverless cars, both of which are bolstered by advances in world models. It’s time to better understand how these bots think.

“So with a language model, you have a sentence, and it will predict the next word in the sentence,” says Oliver Cameron, the CEO of Odyssey , an AI lab focused on world models. ” These 3D generations can be used as digital training grounds. “They’re simulations, but they look and feel real,” he says.

Source link