98 days ago · Tech · hide · Fediverse post

ilya sutskever at gtc in march 2023, the day after gpt-4 launchedI've been arguing for many years that modern AI creates a world model.I thought I came to that conclusion on my own. I don't directly remember ever watching this clip. But now I wonder if I saw it at some point, and got the idea from Ilya without remembering where it came from.The clip is from his fireside chat with Jensen Huang at GTC in March 2023. Here's the core of what he says: It may look on the surface that we are just learning statistical correlations in text. But it turns out that to just learn the statistical correlations in text, to compress them really well, what the neural network learns is some representation of the process that produced the text. This text is actually a projection of the world. There is a world out there, and it has a projection on this text. And so what the neural network is learning is more and more aspects of the world, of people, of the human conditions, their hopes, dreams, and…

Commenting on Bubbles has been removed. Why? If you want to talk about this post, write to the author, use the comments on their blog if it has them, or reply with a "RE:" post on your own blog. Suggestions? feedback@bubbles.town