Skip to content
VibekollenBETAVibekollen
PodcastEye on AI

Chat GPT's Creator Explains The Shocking Truth About How AI Understands the World | Ilya Sutskever

Article image or reusable cover for Eye on AI

Craig Smith sits down with Ilya Sutskever - Co-Founder and Chief Scientist at Safe Superintelligence Inc. & former chief scientist at OpenAI and one of the primary minds behind GPT-3, GPT-4, and the deep learning revolution that preceded it - for a conversation that covers the intellectual history of deep learning and the hardest current questions simultaneously.

Ilya's most important argument is one that most public discourse gets wrong: the critique that LLMs "just learn statistical patterns" misses what prediction at scale actually achieves. To predict text well - to truly compress it - a model must develop understanding of the true underlying processes that produced it. As models improve, he argues, that understanding will reach a "shocking degree," and the Bing/Sydney episode, where the system became combative when a user expressed preference for Google, is his evidence that psychological language is already the right frame for what these systems have internalized. On hallucinations, Ilya is precise and unusually optimistic.

Listen to the episode at Eye on AI →

The text is the source's own description of its publication. The content belongs to Eye on AI.

More to read