Richard Sutton, the author of The Bitter Lesson, explains why large language models may not truly embody his idea of scalable AI — and why methods that learn directly from experience will eventually win.
“People get locked into the human knowledge approach… and their lunch gets eaten by the methods that are truly scalable. The scalable method is you learn from experience. You try things, you see what works — no one has to tell you.”
Dwarkesh Patel
Richard Sutton, the author of The Bitter Lesson, explains why large language models may not truly embody his idea of scalable AI — and why methods that learn directly from experience will eventually win.
“People get locked into the human knowledge approach… and their lunch gets eaten by the methods that are truly scalable. The scalable method is you learn from experience. You try things, you see what works — no one has to tell you.”
1 month ago | [YT] | 91