In the fourth installment of our Moonshot Podcast Deep Dive video interview series, X’s Captain of Moonshots Astro Teller sits down with Andrew Ng, the founder of Google Brain and DeepLearning.AI, for a conversation about the history of neural network research and how Andrew’s pioneering ideas led to some of the biggest breakthroughs in modern-day AI.
Hear about the origins of Google’s deep learning work, how Andrew’s teenage frustrations led him to pursue a career in machine learning and automation, and the work that led up to Google Brain’s infamous “cat video” paper.
00:00 - Introduction
03:30 - Andrew’s groundbreaking early theories about neural networks
08:16 - Why Andrew came to X with his ideas
10:30 - The unlikely history of neural network research
15:25 - Jeff Dean as Andrew’s “partner in crime”
17:16 - The origins of Google Brain’s neural networks
18:32 - Google Brain’s evolution in and out of hardware
22:01 - Google Brain’s innovation around transformers
24:36 - Google Brain’s earliest leaps forward in AI
28:24 - Google Brain’s graduation from X into Google
31:50 - What Andrew is up to these days
34:07 - Where the AI and machine learning field is going
35:19 - Andrew’s passion for education
36:51 - Why Andrew became interested in AI as a teenager
37:53 - AI’s democratizing effect on humanity
41:34 - How Andrew defines the term “artificial intelligence”
43:51 - Google Brain’s “cat video” coming out moment
45:51 - AI’s potential positive impact on the workforce
47:17 - Andrew’s favorite aspects of moonshot-taking