How Dopamine & Serotonin Shape Decisions, Motivation & Learning | Dr. Read Montague

Huberman and Montague dismantle the popular 'dopamine equals pleasure' idea, explaining that dopamine is really a learning signal that encodes the difference between one expectation and the next, not just expectation versus reward. They show this temporal-difference reinforcement-learning rule is the same algorithm DeepMind used for AlphaGo and AlphaFold, and that it is installed in brains from honeybees to humans. The conversation covers serotonin as dopamine's opponent, how SSRIs may push serotonin into dopamine terminals and dull reward, and how stress and hunger can flip dopamine from coding rewards to coding threats. Montague describes recording neurotransmitters directly from the human brain and even through probes up the nose, and how AI may soon let people read their own dopamine and serotonin in real time. Threaded throughout are practical themes: foraging in dating, screen time and ADHD-like states, the value of effort and sports, and using deliberate delays to learn better.

• Montague says dopamine is most clearly a learning signal, not a pleasure signal, and that the best modern work on it came out of artificial intelligence.
  00:04:42
• The core claim: dopamine encodes the difference between successive expectations (temporal-difference error), not just expectation versus reward.
  00:11:24
• The exact reinforcement-learning algorithm dopamine runs is what DeepMind used to build AlphaGo Zero, which 'beats the history of Go' and has never been beaten.
  00:22:21
• Across all their human recordings, dopamine and serotonin are opponent: when one goes up, the other goes down.
  01:04:30
• SSRIs push serotonin into dopamine terminals, which can blunt reward and may teach people to negatively condition on things they should pursue.
  01:06:33
• When animals (and likely people) are made hungry or stressed, dopamine flips role and starts encoding punishment-prediction errors instead of reward.
  01:11:51
• His team can record dopamine and serotonin from healthy people via a minimally invasive probe snaked up the nose to the olfactory epithelium.
  01:33:41
• Montague endorses Claude AI ('I love Claude'), using it to compare and contrast scientists' theories in ways PubMed cannot.
  02:13:52

• The same learning rule appears in B. subtilis brains, sea-slug brains, songbirds and humans; in honeybee brains it is probably octopamine rather than dopamine.
  00:11:55
• By the time Parkinson's symptoms appear, a person has already lost 70 to 75 percent of the dopamine neurons in their brain stem.
  00:32:12
• Only about 80,000 dopamine neurons per side (160,000 total) wire the entire brain and spinal cord through hundreds of millions of connections.
  00:33:14
• Honeybees fall on an 'ADD bee' to 'concentration bee' axis set by the ratio of octopamine to tyramine, the bee analogue of dopamine to serotonin.
  00:40:33
• A study found that a phone merely sitting face-down in the same room lowers cognitive performance, which recovers when the phone is in another room.
  00:57:48
• An Israeli study of judges found rulings differed sharply depending on whether the judge had eaten; 'you really want a judge that's had a good lunch.'
  01:13:26
• A 2005 paper by John Dani in Neuron showed SSRIs route serotonin into the dopamine system via the dopamine transporter, a roughly 40 percent effect.
  01:28:31
• The human brain runs on about 23 watts, whereas a server chip would burst into flames within minutes if its cooling were turned off.
  02:04:35
• AlphaFold solved protein-structure prediction, a problem the NIH may have spent around 100 billion dollars on over 70 years.
  02:18:36
• For psychotropic medications, 50 to 80 percent of a good outcome can be a placebo effect, which Montague stresses is not a fake effect.
  02:31:33

Books, products and media the guest or host genuinely endorsed here — with the buy link.

Affiliate link — we may earn a commission at no extra cost to you.