Home Andrew Huberman Notes
Andrew Huberman · 2024-11-18 · 2h 34m

How to Improve at Learning Using Neuroscience & AI | Dr. Terry Sejnowski

Computational neuroscientist Terry Sejnowski explains how a single learning algorithm drives motivation, how to learn better, and why AI and brains are converging.

How to Improve at Learning Using Neuroscience & AI | Dr. Terry Sejnowski
The guest

Dr. Terry Sejnowski — Professor at the Salk Institute who directs the Computational Neurobiology Laboratory and is a pioneer of computational neuroscience and machine learning. He co-created the Boltzmann machine with Nobel laureate Geoffrey Hinton and co-founded the wildly popular 'Learning How to Learn' online course.

The gist

Andrew Huberman and Terry Sejnowski explore how the brain works at the 'algorithmic' level between molecules and behavior, centering on the reinforcement-learning value function that governs all motivation via dopamine. They contrast cognitive vs. procedural learning and argue both are essential, warning against schools dropping practice-based learning. The conversation covers practical tools for better learning, sleep spindles and memory consolidation, exercise and mitochondria as the key to lifelong energy, and the surprising parallels between large language models and the human brain. They also dig into ketamine, schizophrenia, the glutamate hypothesis, Parkinson's, free will, consciousness, dreams, and how AI can act as an 'idea pump' to forage future scientific discoveries.

Big reveals

  • Sejnowski says neuroscience now knows the actual brain algorithm for learning sequences of actions: simply predict the next reward (temporal difference learning) - the same algorithm that powered DeepMind's AlphaGo.
  • He criticizes California schools for trying to eliminate procedural (practice-based) learning, calling it 'ridiculous' and 'crazy.'
  • Ambien (zolpidem) doubles sleep spindles, and a study found it lets you remember twice as much of what you learned before taking it - but it wipes out memories formed after.
  • A China study found Alzheimer's onset was earliest in people with no education and latest in the most educated, suggesting cognitive reserve delays the disease.
  • Ketamine fights depression by inducing 'a touch of schizophrenia' - over-exciting an under-excited depressed cortex back into balance.
  • Locked-in Parkinson's patients given L-DOPA started talking again; though they barely moved, they cognitively believed they were moving at super velocity - a 'set point' problem.
  • Sejnowski's colleague Rusty Gage uses large language models as an 'idea pump,' feeding them all his experiments and the literature to generate new experiment ideas.

Things worth remembering

  • There is more input coming into the visual cortex from the motor system than from the eye itself.
  • The brain often needs only one example to generalize - like learning the whole process of going to a restaurant after a single visit.
  • Sleep spindles (1-2 second traveling waves circling the cortex) consolidate the day's experiences into long-term memory without overwriting existing knowledge.
  • The peak demographic benefiting from the 'Learning How to Learn' course is ages 25-35, not students - and the course has been taken by 4 million people in 200 countries.
  • A writer found ChatGPT far less mentally fatiguing once she treated it politely like a human, tapping into the brain's effortless social circuits.
  • Exercise is described as 'the best drug you could ever take' - it replenishes mitochondrial energy and benefits every organ system, including the brain.
  • In a dermatology study, expert doctors and AI each scored ~90% on skin lesions, but doctors using AI jumped to 98% by combining different strengths.
  • AI trained on hurricane data can predict Florida landfall far more accurately than supercomputer simulations - and does it on a laptop in 10 minutes.
  • The biggest difference between an LLM and a human brain: a quiet human keeps generating internal thoughts, while an LLM goes blank with no self-generated activity.
  • LLMs show 'in-context learning' - getting better through a dialogue despite having no plasticity or new training - a mystery neuroscientists also can't explain for humans.

Recommended in this episode

Books, products and media the guest or host genuinely endorsed here — with the buy link.

Affiliate link — we may earn a commission at no extra cost to you.

Guest’s ownBook

The Computational Brain

Terry Sejnowski and Patricia Churchland

“I have a u Pat church and I wrote a book computational Brain and in it there's this levels diagram” — Terry Sejnowski 00:07:19
Find it on Amazon
Guest’s ownMedia

Learning How to Learn

Barbara Oakley and Terry Sejnowski (Coursera)

“Barbara Oakley ... and I have a a moo massive open online course on learning how to learn ... it's free completely free” — Terry Sejnowski 00:23:33
Find it on Amazon
RecommendedProduct

Claude AI

Anthropic

“I really like the um aesthetic of Claude AI it's a bit of a softer beige aesthetic it feels kind of apple like ... I'm a big fan of it” — Andrew Huberman 01:18:06
Find it on Amazon
Guest’s ownBook

ChatGPT and the Future of AI

Terry Sejnowski

“my book uh chat GDP in the future of AI I went through and I looked at other people's experiences with chat GDP” — Terry Sejnowski 01:00:56
Find it on Amazon
Guest’s ownBook

Protocols: An Operating Manual for the Human Body

Andrew Huberman

“I have a new book coming out ... it's entitled protocols and operating manual for the human body ... available by pre-sale at protocols book.com” — Andrew Huberman 02:32:13
Find it on Amazon