Ilya Sutskever is renowned for his vision when it comes to deep learning. A lot of his now popular quotes come from his 2023 appearance on the Dwarkesh Podcast. I was recently sent this clip of him discussing deep learning in 2015 and was taken aback by how correct he was so long ago, and particularly by how little has changed. With this, I wanted to share an annotated transcript with my thoughts.

Go to Source