Temporal difference model reproduces anticipatory neural activity. (English) Zbl 1003.92010
Summary: Anticipatory neural activity preceding behaviorally important events has been reported in cortex, striatum, and midbrain dopamine neurons. Whereas dopamine neurons are phasically activated by reward-predictive stimuli, anticipatory activity of cortical and striatal neurons is increased during delay periods before important events. Characteristics of dopamine neuron activity resemble those of the prediction error signals of the temporal difference (TD) model of Pavlovian learning.
This study demonstrates that the prediction signal of the TD model reproduces characteristics of cortical and striatal anticipatory neural activity. This finding suggests that tonic anticipatory activities may reflect prediction signals that are involved in the processing of dopamine neuron activity.
This study demonstrates that the prediction signal of the TD model reproduces characteristics of cortical and striatal anticipatory neural activity. This finding suggests that tonic anticipatory activities may reflect prediction signals that are involved in the processing of dopamine neuron activity.
MSC:
| 92C20 | Neural biology |
Keywords:
temporal difference model; tonic anticipatory activity; cortex; striatum; midbrain dopamine neuronsReferences:
| [1] | Alexander G. E., J. Neurophysiol. 64 pp 133– (1990) |
| [2] | Alexander G. E., J. Neurophysiol. 64 pp 164– (1990) |
| [3] | Apicella P., J. Neurophysiol. 68 pp 945– (1992) |
| [4] | Blair H. T., J. Neurophysiol. 78 (1) pp 145– (1997) |
| [5] | Brown J., J. Neurosci. 19 (23) pp 10502– (1999) |
| [6] | DOI: 10.1111/j.1460-9568.1992.tb00119.x · doi:10.1111/j.1460-9568.1992.tb00119.x |
| [7] | Calabresi P., J. Neurosci. 17 (12) pp 4536– (1997) |
| [8] | DOI: 10.1162/neco.1993.5.4.613 · doi:10.1162/neco.1993.5.4.613 |
| [9] | DOI: 10.1007/BF00361347 · doi:10.1007/BF00361347 |
| [10] | DOI: 10.1007/BF00198087 · doi:10.1007/BF00198087 |
| [11] | DOI: 10.1162/jocn.1995.7.3.311 · doi:10.1162/jocn.1995.7.3.311 |
| [12] | DOI: 10.1126/science.1553535 · doi:10.1126/science.1553535 |
| [13] | Goldberg M. E., J. Neurophysiol. 64 (2) pp 489– (1990) |
| [14] | DOI: 10.1016/0893-6080(89)90026-9 · doi:10.1016/0893-6080(89)90026-9 |
| [15] | Hikosaka O., J. Neurophysiol. 4 (4) pp 814– (1989) |
| [16] | DOI: 10.1038/1124 · doi:10.1038/1124 |
| [17] | Hollerman J. R., J. Neurophysiol. 80 (2) pp 947– (1998) |
| [18] | Kermadi I., J. Neurophysiol. 74 pp 911– (1995) |
| [19] | Ljungberg T., J. Neurophysiol. 67 pp 145– (1992) |
| [20] | DOI: 10.1007/BF00239513 · doi:10.1007/BF00239513 |
| [21] | Mirenowicz J., J. Neurophysiol. 72 pp 1024– (1994) |
| [22] | Montague P. R., J. Neurosci. 16 (5) pp 1936– (1996) |
| [23] | Nakamura K., Soc. Neurosci. Abstr. 25 (1) pp 1163– (1999) |
| [24] | DOI: 10.1162/neco.1997.9.4.721 · doi:10.1162/neco.1997.9.4.721 |
| [25] | DOI: 10.1038/4580 · doi:10.1038/4580 |
| [26] | DOI: 10.1007/BF00227836 · doi:10.1007/BF00227836 |
| [27] | Schultz W., J. Neurophysiol. 80 pp 1– (1998) |
| [28] | Schultz W., J. Neurosci. 13 pp 900– (1993) |
| [29] | DOI: 10.1016/S0079-6123(08)61349-7 · doi:10.1016/S0079-6123(08)61349-7 |
| [30] | Schultz W., Journal of Neuroscience 12 (12) pp 4595– (1992) |
| [31] | DOI: 10.1126/science.275.5306.1593 · doi:10.1126/science.275.5306.1593 |
| [32] | DOI: 10.1007/BF00227834 · doi:10.1007/BF00227834 |
| [33] | DOI: 10.1093/cercor/10.3.272 · doi:10.1093/cercor/10.3.272 |
| [34] | DOI: 10.1007/s002210050467 · doi:10.1007/s002210050467 |
| [35] | DOI: 10.1016/S0306-4522(98)00697-6 · doi:10.1016/S0306-4522(98)00697-6 |
| [36] | Tremblay L., J. Neurophysiol. 80 (2) pp 964– (1998) |
| [37] | DOI: 10.1038/19525 · doi:10.1038/19525 |
| [38] | Tremblay L., J. Neurophysiol. 83 (4) pp 1864– (2000) |
| [39] | Umeno M. M., J. Neurophysiol. 78 (3) pp 1373– (1997) |
| [40] | Walker M. F., J. Neurophysiol. 73 (5) pp 1988– (1995) |
| [41] | DOI: 10.1038/382629a0 · doi:10.1038/382629a0 |
| [42] | DOI: 10.1016/0306-4522(95)00436-M · doi:10.1016/0306-4522(95)00436-M |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
