A partial history of the serotonin literature

Writing a short history of the serotonin literature is a daunting task, not because the history of the field is especially long, but because it is so complicated.

From humble beginnings as a nuisance that causes blood vessel contraction (Whitaker-Azmitia, 1999; open access), serotonin is now believed to be involved in everything from the circadian rhytm to locomotor gain to escape reflexes. Thanks to antidepressants and certain recreational drugs, the best known function of serotonin is probably its involvement in regulating mood, although the very concept of mood is difficult to pin down and the extent of serotonin's involvement remains controversial.

My personal area of interest is in the reward learning slice of the serotonin field. Ever since Schultz, Dayan, and Montague established a connection between the activity of dopamine neurons and reward prediction error in the late 1990s, serotonin researchers have been hoping for a similar watershed moment. Disappointingly, more than twenty five years later, this corner of the serotonin field still has not coalesced.

Instructions

This page represents my attempt at a partial history of the reward learning part of the serotonin literature. Each dot represents a paper that I consider influential (even if I don't personally buy the main claims), arranged from left to right according to publication date. The size of the dot represents the average number of Google Scholar citations per year, which is not a great measure of impact but is the best I could come up with for a blog post, and lines connect dots that I think follow the same conceptual thread.

Hover your cursor over the labels below to highlight papers with similar ideas, then click on the dots for details about individual papers. Refresh the page to get back to this screen.

Reward thread
Surprise thread
Patience thread
Complexity thread

Opponent interactions between serotonin and dopamine

Daw et al., 2002

Influential ideas:

  • Serotonin is involved in aversion.
  • Phasic and tonic firing.

Coding of task reward value in the dorsal raphe nucleus

Bromberg-Martin et al., 2010

Influential idea: serotonin is involved in reward.

Extract from figure 3 of Bromberg-Martin et al., 2010 showing raphe neuron responses to rewards and reward omissions.

Serotonin neurons in the dorsal raphe nucleus encode reward signals

Li et al., 2016

Influential idea: serotonin is involved in reward and is mildly reinforcing.

Excerpt from figure 6 of Li et al., 2016 showing average firing rate of serotonin neurons as mice consume an expected reward.

Learning and stress shape the reward response patterns of serotonin neurons

Zhong et al., 2017

Influential ideas:

  • Serotonin and dopamine are both involved in reward.
  • Head-fixed and freely-moving experiments are hard to compare.
Details

In this work, Zhong et al. measure the activity of DRN serotonin and VTA dopamine neurons as mice learned to associate a cue with a reward. Using fiber photometry to measure the bulk calcium activity of each population of neurons in freely-moving animals, they show that dopamine neurons initially exhibit a strong reward response that gradually transfers to the cue, as expected for a reward prediction error, while serotonin neurons exhibit a constant response to the reward itself and a pre-reward ramp that emerges gradually over the course of learning. These observations are very important for reinforcement learning-based theories of serotonergic function, because they suggest that serotonin neurons are involved in signalling expected future reward, rather than surprise or a prediction error.

The idea that serotonin neurons encode reward expectation rather than punishment or surprise contrasts with ideas in another branch of the serotonin literature. Possibly in an effort to reconcile these ideas, the authors also show that various sources of stress, including head restraint used routinely in the branch of the literature in question, dramatically suppress the responses of both serotonin and dopamine neurons. Exactly how this suppression could produce the appearance of a surprise or punishment code remains unclear.

Excerpt from figure 1 of Zhong et al., 2017 showing how activity patterns of serotonin and dopamine neurons evolve over the course of learning.

Transient firing of dorsal raphe neurons encodes diverse and specific sensory, motor, and reward events

Ranade et al., 2009

Influential ideas:

  • Phasic firing exists.
  • Tuning features are messy.
Figure 7 from Ranade et al., 2009 showing diverse responses of raphe neurons to movement and stimuli.

Serotonergic neurons signal reward and punishment on multiple timescales

Cohen et al., 2015

Influential ideas:

  • Tonic and phasic firing are involved in reward and punishment in different ways.
  • Tuning features are really messy.
Extract from figure 3 of Cohen et al., 2015 showing complex responses of a serotonin neuron to rewards and punishments over short and long timescales.

Activity patterns of serotonin neurons underlying cognitive flexibility

Matias et al., 2017

Influential idea: serotonin neurons do not signal reward or punishment, they signal surprise to modulate learning.

Extract from figure 7 of Matias et al., 2017 showing that serotonin neurons respond more strongly to rewards that are surprising than rewards that are predicted.

An effect of serotonergic stimulation on learning rates for rewards apparent after long intertrial intervals

Iigaya et al., 2018

Influential ideas:

  • Serotonin is not reinforcing.
  • Serotonin modulates learning.
Excerpt from figure 1 of Iigaya et al., 2018 showing that serotonin neuron activation is not reinforcing.

Serotonin neurons modulate learning rate through uncertainty

Grossman et al., 2022

Influential ideas:

  • Serotonin signals something aligned to surprise/certainty, not reward/punishment.
  • Serotonin modulates learning.
Extract from figure 2 of Grossman et al., 2022 illustrating meta-learning model.

Metalearning and neuromodulation

Doya, 2002

Influential idea: serotonin modulates perceived immediacy of future rewards.

Figure 7 from Doya, 2002 illustrating the effect of changes in discounting on value.

Low-serotonin levels increase delayed reward discounting in humans

Schweighofer et al., 2008

Influential idea: serotonin modulates perceived immediacy of future rewards.

Figure 1 from Schweighofer et al., 2008 illustrating the delayed reward choice task.

Activation of dorsal raphe serotonin neurons underlies waiting for delayed rewards

Miyazaki et al., 2011

Influential idea: serotonin neuron activity supports waiting for future reward.

Excerpt from figure 3 of Miyazaki et al., 2011 showing that serotonin neurons are activated during reward anticipation/waiting.

Activation of serotonin neurons promotes active persistence in a probabilistic foraging task

Lottem et al., 2018

Influential idea: waiting effects are not due to behavioural inhibition.

Details

A series of optogenetic studies in rodents showed that activating serotonin neurons promotes passive waiting for delayed rewards. While these results have been interpreted as evidence that serotonin promotes patience or persistence, it could also be that dorsal raphe serotonin neurons simply decrease locomotor activity. In this work, Lottem et al. show that optogenetically activating serotonin neurons increases active reward seeking behaviour (nose poking), supporting an effect of serotonin on patience or persistence rather than locomotor inhibition.

Extract from figures 1 and 5 of Lottem et al., 2018 showing that serotonin neuron activation promotes active persistence in a foraging task.
Excerpts from figures 1 and 5 of Lottem et al., 2018 showing that activation of serotonin neurons promotes exploitation of the current source of reward.

Reward probability and timing uncertainty alter the effect of dorsal raphe serotonin neurons on patience

Miyazaki et al., 2018

Influential idea: serotonin may encode prior probability of reward.


The differential effect of optogenetic serotonergic manipulation on sustained motor actions and stationary waiting for future rewards in mice

Taira et al., 2024

Main idea: waiting effects might be due to behavioural inhibition?

Dorsal raphe neurons integrate the values of reward amount, delay, and uncertainty in multi-attribute decision-making

Feng et al., 2024

Main idea: dorsal raphe neurons encode future reward, but it's complicated.

Raphe serotonin neurons are not homogenous: Electrophysiological, morphological and neurochemical evidence

Calizo et al., 2011

Influential idea: serotonin neurons are variable on a cellular level.

Details

In computational and systems neuroscience, a neural system usually refers to a group of neurons with a common function in terms of behaviour, perception, or cognition (for example, the visual system). In other areas of neuroscience, the term system might refer to parts of the brain that express a common molecular marker but with diverse effects on behaviour, etc. (for example, the endocannabinoid system). This work represents an early example of an ongoing shift in the serotonin literature away from the idea that the dorsal raphe can be seen as a neural system in the computational and systems neuroscience sense.

In this work, the authors show that serotonin neurons in different parts of the dorsal raphe nucleus (and in the dorsal vs. median raphe nuclei) have different biochemical, morphological, and electrophysiological features. While there is overlap in the properties of neurons from different raphe sub-regions, this work marks an important step towards a "glass half heterogenous" view of the raphe.

Extract from figure 15 of Calizo et al., 2011 showing variable dendritic morphology of serotonin neurons.

Multiscale single-cell analysis reveals unique phenotypes of raphe 5-HT neurons projecting to the forebrain

Fernandez et al., 2016 (Open access)

Influential idea: serotonin neurons projecting to different regions have different properties.

Extract from figure 2 of Fernandez et al., 2016 showing differences in excitability between basolateral amygdala, medial prefrontal cortex, and dorsal hippocampus-projecting neurons.

Anatomically defined and functionally distinct dorsal raphe serotonin sub-systems

Ren et al., 2018

Influential idea: there is no single serotonin system.

Details

If there were a single part of the brain we could point to and call "the serotonin system" in a computational and systems neuroscience sense (see details related to Calizo et al., 2011), the dorsal raphe nucleus would be it. Here, Ren et al. make the case that not even the dorsal raphe fits the bill.

Much like the earlier work of Fernandez et al., Ren et al. show that dorsal raphe serotonin neurons projecting to the amygdala and frontal cortex are mostly not the same cells, are generally located in different parts of the raphe, and receive somewhat different inputs. Ren et al. take these results a step further by showing that these two groups of neurons display different responses to rewarding and aversive stimuli, and that optogeneticaly activating them has different behavioural effects.

The idea that serotonin neurons within the dorsal raphe are at least somewhat specialized is now impossible to ignore.

Graphical abstract from Ren et al., 2018.

Single-cell activity and network properties of dorsal raphe nucleus serotonin neurons during emotionally salient behaviors

Paquelet et al., 2022

Influential idea: there is no single serotonin system and it's complicated.

Extract from figure 7 from Paquelet et al., 2022 showing that serotonin neurons projecting to different regions respond mostly — but not entirely — differently to various stimuli.

Activation of dorsal raphe serotonergic neurons promotes waiting but is not reinforcing

Fonseca et al., 2015

Extract from figure 5 of Fonseca et al., 2015 showing that serotonin neuron stimulation has no effect on conditioned place preference.

Temporal derivative computation in the dorsal raphe network revealed by an experimentally driven augmented integrate-and-fire modeling framework

Harkin et al., 2023

Main ideas:

  • Serotonin neurons output the rate of change of their input.
  • There is complexity, but computational relevance is not clear.
Figure 7 supplement 2 from Harkin et al., 2023 showing that the firing rate of a simulated population of serotonin neurons resembles a mixture of the intensity and rate of change of its input.