Ian Goodfellow: Generative Adversarial Networks (GANs) | Lex Fridman Podcast #19

Lex Fridman interviews Ian Goodfellow about the current limits of deep learning, including its heavy reliance on labeled data and its relationship to reasoning and cognition. Goodfellow explains how generative adversarial networks work as a two-player game between a generator and a discriminator that reaches a Nash equilibrium. They discuss adversarial examples as a security liability, semi-supervised learning, fairness, differential privacy, and using GANs for data augmentation. The conversation closes on deepfakes, authentication, what artificial general intelligence might require, and the importance of securing machine learning against adversaries.

• Goodfellow says the GAN idea came from an argument at a bar; he went home at midnight, coded it, and it worked the first time.
  00:26:38
• He admits a little drinking lowered his inhibitions enough to try the idea, which he might have shot down sober.
  00:27:41
• He explains the generator/discriminator game where the generator learns to produce realistic data by fooling the discriminator.
  00:32:23
• He reveals generative models that did exactly what is asked would just memorize the training data, yet GANs generalize anyway and nobody fully knows why.
  00:33:58
• A semi-supervised GAN got below 1% MNIST error with only 100 labeled examples, a roughly 600x reduction in needed labels.
  00:43:47
• Goodfellow says he is far less worried about deepfakes 20 years out than the next few bumpy years of cultural transition.
  00:55:12
• He says it is straightforward to prove he is human today, but proving content is real from the content alone is incredibly hard.
  01:04:38

• His deep learning book opens with a Russian-doll diagram showing deep learning inside representation learning inside machine learning inside AI.
  00:01:32
• Humans do not learn to play Pong by failing two million times, unlike reinforcement learning algorithms.
  00:01:32
• A 2016 paper called Hidden Voice Commands made sounds humans cannot understand but phones recognize as target commands.
  00:12:58
• The Deep Image Prior paper shows a convolutional net architecture is useful for inpainting even without learning any parameters.
  00:35:33
• The first GAN paper used MNIST, the Toronto Face Database, and CIFAR-10, with mostly unrecognizable early samples.
  00:40:41
• The DC-GAN paper sparked a Cambrian explosion of GAN variants and became a widely used baseline backbone.
  00:41:44
• CycleGAN tends to make horses greener because horses appear on grass while zebras appear on drier terrain in the data.
  00:45:55
• A paper from Casey Greene's lab trained GANs with differential privacy to produce fake patient data safe for researchers.
  00:51:38

Books, products and media the guest or host genuinely endorsed here — with the buy link.

Affiliate link — we may earn a commission at no extra cost to you.