×

Accuracy and response-time distributions for decision-making: linear perfect integrators versus nonlinear attractor-based neural circuits. (English) Zbl 1382.92069

Summary: Animals choose actions based on imperfect, ambiguous data. “Noise” inherent in neural processing adds further variability to this already-noisy input signal. Mathematical analysis has suggested that the optimal apparatus (in terms of the speed/accuracy trade-off) for reaching decisions about such noisy inputs is perfect accumulation of the inputs by a temporal integrator. Thus, most highly cited models of neural circuitry underlying decision-making have been instantiations of a perfect integrator. Here, in accordance with a growing mathematical and empirical literature, we describe circumstances in which perfect integration is rendered suboptimal. In particular we highlight the impact of three biological constraints: (1) significant noise arising within the decision-making circuitry itself; (2) bounding of integration by maximal neural firing rates; and (3) time limitations on making a decision. Under conditions (1) and (2), an attractor system with stable attractor states can easily best an integrator when accuracy is more important than speed. Moreover, under conditions in which such stable attractor networks do not best the perfect integrator, a system with unstable initial states can do so if readout of the system’s final state is imperfect. Ubiquitously, an attractor system with a nonselective time-dependent input current is both more accurate and more robust to imprecise tuning of parameters than an integrator with such input. Given that neural responses that switch stochastically between discrete states can “masquerade” as integration in single-neuron and trial-averaged data, our results suggest that such networks should be considered as plausible alternatives to the integrator model.

MSC:

92C20 Neural biology
92D50 Animal behavior

References:

[1] Abeles, M., Bergman, H., Gat, I., Meilijson, I., Seidemann, E., Tishby, N., & Vaadia, E. (1995). Cortical activity flips among quasi-stationary states. Proceedings of the National Academy of Sciences of the United States of America, 92, 8616-8620.
[2] Balci, F., Simen, P., Niyogi, R., Saxe, A., Hughes, J. A., Holmes, P., & Cohen, J. D. (2011). Acquisition of decision making criteria: reward rate ultimately beats accuracy. Attention, Perception, & Psychophysics, 73, 640-657.
[3] Beck, J. M., Ma, W. J., Kiani, R., Hanks, T., Churchland, A. K., Roitman, J., Shadlen, M. N., Latham, P. E., & Pouget, A. (2008). Probabilistic population codes for Bayesian decision making. Neuron, 60, 1142-1152.
[4] Bertsekas, D. P. (2005). Dynamic Programming and Optimal Control. Belmont: Athena Scientific. · Zbl 1125.90056
[5] Bogacz, R., Brown, E., Moehlis, J., Holmes, P., & Cohen, J. D. (2006). The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. Psychological Review, 113, 700-765.
[6] Bogacz, R., Hu, P. T., Holmes, P. J., & Cohen, J. D. (2010). Do humans produce the speed-accuracy trade-off that maximizes reward rate? Quarterly Journal of Experimental Psychology, 63, 863-891.
[7] Bollimunta, A., Totten, D., & Ditterich, J. (2012). Neural dynamics of choice: single-trial analysis of decision-related activity in parietal cortex. The Journal of neuroscience: the official journal of the Society for Neuroscience, 32, 12684-12701.
[8] Bouvrie, J., Slotine, J.J. (2011). Synchronization and Redundancy: Implications for Robustness of Neural Learning and Decision Making. Neural Computation 23, 2915-2941. · Zbl 1237.92010
[9] Broderick, T., Wong-Lin, K. F., & Holmes, P. (2009). Closed-form approximations of first-passage distributions for a stochastic decision-making model. Applied Mathematical Research Express, 2009, 123-141. · Zbl 1186.91061
[10] Brody, C. D., Hernández, A., Zainos, A., Lemus, L., & Romo, R. (2003). Timing and neural encoding of somatosensory parametric working memory in macaque prefrontal cortex. Cerebral Cortex, 13, 1196-1207.
[11] Brown, E., Gao, J., Holmes, P., Bogacz, R., Gilzenrat, M., & Cohen, J. D. (2005). Simple neural networks that optimize decisions. International Journal of Bifurcation and Chaos, 15, 803-826. · Zbl 1069.92004
[12] Churchland, A. K., Kiani, R., & Shadlen, M. N. (2008). Decision-making with multiple alternatives. Nature Neuroscience, 11, 693-702.
[13] Churchland, A. K., Kiani, R., Chaudhuri, R., Wang, X. J., Pouget, A., & Shadlen, M. N. (2011). Variance as a signature of neural computations during decision making. Neuron, 69, 818-831.
[14] Cisek, P., Puskas, G. A., & El-Murr, S. (2009). Decisions in changing conditions: the urgency-gating model. Journal of Neuroscience, 29, 11560-11571.
[15] Compte, A., Brunel, N., Goldman-Rakic, P. S., & Wang, X. J. (2000). Synaptic mechanisms and network dynamics underlying spatial working memory in a cortical network model. Cerebral Cortex, 10, 910-923.
[16] Deco, G., & Marti, D. (2007). Extended method of moments for deterministic analysis of stochastic multistable neurodynamical systems. Physical Review. E, Statistical, Nonlinear, and Soft Matter Physics, 75, 031913.
[17] Deco, G., & Rolls, E. T. (2006). Decision-making and Weber’s law: a neurophysiological model. European Journal of Neuroscience, 24, 901-916.
[18] Deco, G., Rolls, E. T., & Romo, R. (2009). Stochastic dynamics as a principle of brain function. Progress in Neurobiology, 88, 1-16.
[19] Deco, G., Rolls, E. T., Albantakis, L., Romo, R. (2013). Brain mechanisms for perceptual and reward-related decision-making. Progress in Neurobiology, 103, 194-213.
[20] Ditterich, J. (2006). Evidence for time-variant decision making. The European Journal of Neuroscience, 24, 3628-3641.
[21] Drugowitsch, J., Moreno-Bote, R., Churchland, A. K., Shadlen, M. N., & Pouget, A. (2012). The cost of accumulating evidence in perceptual decision making. The Journal of neuroscience: the official journal of the Society for Neuroscience, 32, 3612-3628.
[22] Eckhoff, P., Holmes, P., Law, C., Connolly, P. M., & Gold, J. I. (2008). On diffusion processes with variable drift rates as models for decision making during learning. New Journal of Physics, 10, nihpa49499.
[23] Eckhoff, P., Wong-Lin, K. F., & Holmes, P. (2009). Optimality and robustness of a biophysical decision-making model under norepinephrine modulation. The Journal of neuroscience: the official journal of the Society for Neuroscience, 29, 4301-4311.
[24] Eckhoff, P., Wong-Lin, K., & Holmes, P. (2011). Dimension reduction and dynamics of a spiking neural network model for decision making under neuromodulation. SIAM Journal on Applied Dynamical Systems, 10, 148-188. · Zbl 1217.34079
[25] Farkas, Z., & Fülöp, T. (2001). One-dimensional drift-diffusion between two absorbing boundaries: application to granular segregation. Journal of Physics AA: Mathematical and General, 34, 3191-3198. · Zbl 1028.82530
[26] Feng, S., Holmes, P., Rorie, A., & Newsome, W. T. (2009). Can monkeys choose optimally when faced with noisy stimuli and unequal rewards? PLoS Computational Biology, 5, e1000284.
[27] Frazier, P. I., Yu, A. J. (2007). Sequential hypothesis testing under stochastic deadlines. In J. C. Platt, et al. (Eds.), Advances in Neural Information Processing Systems (NIPS), vol. 20 (p. 953). · Zbl 0990.92002
[28] Gammaitoni, L., & Hänggi, P. (1998). Stochastic Resonance. Reviews of Modern Physics, 70, 223-287.
[29] Gat, I., Tishby, N., Abeles, M. (1997). Hidden markov modeling of simultaneously recorded cells in the associative cortex of behaving monkeys. · Zbl 0903.92007
[30] Genovesio, A., Tsujimoto, S., & Wise, S. P. (2006). Neuronal activity related to elapsed time in prefrontal cortex. Journal of Neurophysiology, 95, 3281-3285.
[31] Glimcher, P. W. (2001). Making choices: the neurophysiology of visual-saccadic decision making. Trends in Neurosciences, 24, 654-659.
[32] Glimcher, P. W. (2003). The neurobiology of visual-saccadic decision making. Annual Review of Neuroscience, 26, 133-179.
[33] Gluckman, B. J., So, P., Netoff, T. I., Spano, M. L., & Schiff, S. J. (1998). Stochastic resonance in mammalian neuronal networks. Chaos, 8, 588-598. · Zbl 0990.92002
[34] Gold, J. I., & Shadlen, M. N. (2000). Representation of a perceptual decision in developing oculomotor commands. Nature, 404, 390-394.
[35] Gold, J. I., & Shadlen, M. N. (2001). Neural computations that underlie decisions about sensory stimuli. Trends in Cognitive Sciences, 5, 10-16.
[36] Gold, J. I., & Shadlen, M. N. (2003). The influence of behavioral context on the representation of a perceptual decision in developing oculomotor commands. The Journal of Neuroscience: the Official Journal of the Society for Neuroscience, 23, 632-651.
[37] Gold, J. I., & Shadlen, M. N. (2007). The neural basis of decision making. Annual Review of Neuroscience, 30, 535-574.
[38] Goldman, M. S., Levine, J. H., Major, G., Tank, D. W., & Seung, H. S. (2003). Robust persistent neural activity in a model integrator with multiple hysteretic dendrites per neuron. Cerebral Cortex, 13, 1185-1195.
[39] Huk, A. C., & Shadlen, M. N. (2005). Neural activity in macaque parietal cortex reflects temporal integration of visual motion signals during perceptual decision making. The Journal of Neuroscience: the Official Journal of the Society for Neuroscience, 25, 10420-10436.
[40] Janssen, P., & Shadlen, M. N. (2005). A representation of the hazard rate of elapsed time in macaque area LIP. Nature Neuroscience, 8, 234-241.
[41] Jones, L. M., Fontanini, A., Sadacca, B. F., Miller, P., & Katz, D. B. (2007). Natural stimuli evoke dynamic sequences of states in sensory cortical ensembles. Proceedings of the National Academy of Sciences of the United States of America, 104, 18772-18777.
[42] Jun, J. K., Miller, P., Hernandez, A., Zainos, A., Lemus, L., Brody, C. D., & Romo, R. (2010). Heterogenous population coding of a short-term memory and decision task. The Journal of Neuroscience: the Official Journal of the Society for Neuroscience, 30, 916-929.
[43] Kiani, R., Hanks, T. D., & Shadlen, M. N. (2008). Bounded integration in parietal cortex underlies decisions even when viewing duration is dictated by the environment. The Journal of Neuroscience: the Official Journal of the Society for Neuroscience, 28, 3017-3029.
[44] Koulakov, A. A., Raghavachari, S., Kepecs, A., & Lisman, J. E. (2002). Model for a robust neural integrator. Nature Neuroscience, 5, 775-782.
[45] Larsen, T., & Bogacz, R. (2010). Initiation and termination of integration in a decision process. Neural Networks, 23, 322-333.
[46] Leon, M. I., & Shadlen, M. N. (2003). Representation of time by neurons in the posterior parietal cortex of the macaque. Neuron, 38, 317-327.
[47] Lo, C. C., & Wang, X. J. (2006). Cortico-basal ganglia circuit mechanism for a decision threshold in reaction time tasks. Nature Neuroscience, 9, 956-963.
[48] Luce, R. D. (1986). Response Times. New York: Oxford University Press.
[49] Luna, R., Hernández, A., Brody, C.D., Romo, R. (2005). Neural codes for perceptual discrimination in primary somatosensory cortex. Nature Neuroscience 8, 1210-1219. · Zbl 1176.60075
[50] Machens, C. K., Romo, R., & Brody, C. D. (2005). Flexible control of mutual inhibition: a neural model of two-interval discrimination. Science, 307, 1121-1124.
[51] Marti, D., Deco, G., Mattia, M., Gigante, G., & Del Giudice, P. (2008). A fluctuation-driven mechanism for slow decision processes in reverberant networks. PLoS One, 3, e2534.
[52] Mazurek, M. E., Roitman, J. D., Ditterich, J., & Shadlen, M. N. (2003). A role for neural integrators in perceptual decision making. Cerebral Cortex, 13, 1257-1269.
[53] McDonnell, M. D., & Abbott, D. (2009). What Is Stochastic Resonance? Definitions, Misconceptions, Debates, and Its Relevance to Biology. PLoS Computational Biology, 5, e1000348.
[54] Meyer-Baese, A., Koshkouei, A. J., Emmett, M. R., & Goodall, D. P. (2009). Global stability analysis and robust design of multi-time-scale biological networks under parametric uncertainties. Neural Networks: the Official Journal of the International Neural Network Society, 22, 658-663. · Zbl 1356.92035
[55] Miller, P., & Katz, D. B. (2010). Stochastic transitions between neural states in taste processing and decision-making. Journal of Neuroscience, 30, 2559-2570.
[56] Miller, P.; Katz, DB; Ding, M. (ed.); Glanzman, DL (ed.), Stochastic Transitions between States of Neural Activity, 29-46 (2011), New York
[57] Miller, P., Brody, C. D., Romo, R., & Wang, X. J. (2003). A recurrent network model of somatosensory parametric working memory in the prefrontal cortex. Cerebral Cortex, 13, 1208-1218.
[58] Mita, A., Mushiake, H., Shima, K., Matsuzaka, Y., & Tanji, J. (2009). Interval time coding by neurons in the presupplementary and supplementary motor areas. Nature Neuroscience, 12, 502-507.
[59] Moreno-Bote, R., Rinzel, J., & Rubin, N. (2007). Noise-induced alternations in an attractor network model of perceptual bistability. Journal of Neurophysiology, 98, 1125-1139.
[60] Nigoyi, R.; Wong-Lin, K., Time-varying gain modulation on neural circuit dynamics and performance in perceptual decisions (2010), Salt Lake City
[61] Okamoto, H., Isomura, Y., Takada, M., & Fukai, T. (2007). Temporal integration by stochastic recurrent network dynamics with bimodal neurons. Journal of Neurophysiology, 97, 3859-3867.
[62] Platt, M. L., & Glimcher, P. W. (1999). Neural correlates of decision variables in parietal cortex. Nature, 400, 233-238.
[63] Ponce-Alvarez, A., Nacher, V., Luna, R., Riehle, A., & Romo, R. (2012). Dynamics of cortical neuronal ensembles transit from decision making to storage for later report. The Journal of Neuroscience: the Official Journal of the Society for Neuroscience, 32, 11956-11969.
[64] Purcell, B. A., Heitz, R. P., Cohen, J. Y., Schall, J. D., Logan, G. D., & Palmeri, T. J. (2010). Neurally constrained modeling of perceptual decision making. Psychological Review, 117, 1113-1143.
[65] Ratcliff, R. (1978). A theory of memory retrieval. Psychological Review, 85, 59-108.
[66] Ratcliff, R. (2008). Modeling aging effects on two-choice tasks: response signal and response time data. Psychology and Aging, 23, 900-916.
[67] Ratcliff, R., & McKoon, G. (2008). The diffusion decision model: theory and data for two-choice decision tasks. Neural Computation, 20, 873-922. · Zbl 1147.68720
[68] Ratcliff, R., & Rouder, J. N. (1998). Modeling response times for two-choice decisions. Psychological Science, 9, 347-356.
[69] Ratcliff, R., Cherian, A., & Segraves, M. (2003). A comparison of macaque behavior and superior colliculus neuronal activity to predictions from models of two-choice decisions. Journal of Neurophysiology, 90, 1392-1407.
[70] Renart, A., Song, P., & Wang, X. J. (2003). Robust spatial working memory through homeostatic synaptic scaling in heterogeneous cortical networks. Neuron, 38, 473-485.
[71] Resulaj, A., Kiani, R., Wolpert, D. M., & Shadlen, M. N. (2009). Changes of mind in decision-making. Nature, 461, 263-266.
[72] Roitman, J. D., & Shadlen, M. N. (2002). Response of neurons in the lateral intraparietal area during a combined visual discrimination reaction time task. Journal of Neuroscience, 22, 9475-9489.
[73] Romo, R., Brody, C. D., Hernández, A., & Lemus, L. (1999). Neuronal correlates of parametric working memory in the prefrontal cortex. Nature, 399, 470-474.
[74] Romo, R., Hernández, A., Zainos, A., Lemus, L., & Brody, C. D. (2002). Neuronal correlates of decision-making in secondary somatosensory cortex. Nature Neuroscience, 5, 1217-1225.
[75] Romo, R., Hernández, A., & Zainos, A. (2004). Neuronal correlates of a perceptual decision in ventral premotor cortex. Neuron, 41, 165-173.
[76] Roxin, A., & Ledberg, A. (2008). Neurobiological models of two-choice decision making can be reduced to a one-dimensional nonlinear diffusion equation. PLoS Computational Biology, 4, e1000046.
[77] Rüter, J., Marcille, N., Sprekeler, H., Gerstner, W., & Herzog, M. H. (2012). Paradoxical evidence integration in rapid decision processes. PLoS Computational Biology, 8, e1002382.
[78] Sakai, Y., Okamoto, H., & Fukai, T. (2006). Computational algorithms and neuronal network models underlying decision processes. Neural Networks, 19, 1091-1105. · Zbl 1103.68722
[79] Salinas, E., Shankar, S., Costello, M. G., Zhu, D., & Stanford, T. R. (2010). Waiting is the Hardest Part: Comparison of Two Computational Strategies for Performing a Compelled-Response Task. Frontiers in Computational Neuroscience, 4, 153.
[80] Seidemann, E., Meilijson, I., Abeles, M., Bergman, H., & Vaadia, E. (1996). Simultaneously recorded single units in the frontal cortex go through sequences of discrete and stable states in monkeys performing a delayed localization task. Journal of Neuroscience, 16, 752-768.
[81] Seung, H. S. (1996). How the brain keeps the eyes still. Proceedings of the National Academy of Sciences of the United States of America, 93, 13339-13344.
[82] Seung, H. S., Lee, D. D., Reis, B. Y., & Tank, D. W. (2000). The autapse: a simple illustration of short-term analog memory storage by tuned synaptic feedback. Journal of Computational Neuroscience, 9, 171-185. · Zbl 1044.92018
[83] Shadlen, M. N., & Newsome, W. T. (1996). Motion perception: seeing and deciding. Proceedings of the National Academy of Sciences of the United States of America, 93, 628-633.
[84] Shadlen, M. N., & Newsome, W. T. (2001). Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. Journal of Neurophysiology, 86, 1916-1936.
[85] Shankar, S., Massoglia, D. P., Zhu, D., Costello, M. G., Stanford, T. R., & Salinas, E. (2011). Tracking the temporal evolution of a perceptual judgment using a compelled-response task. The Journal of Neuroscience: the Official Journal of the Society for Neuroscience, 31, 8406-8421.
[86] Shea-Brown, E., Gilzenrat, M. S., & Cohen, J. D. (2008). Optimization of decision making in multilayer networks: the role of locus coeruleus. Neural Computation, 20, 2863-2894. · Zbl 1160.68515
[87] Silver, M. R., Grossberg, S., Bullock, D., Histed, M. H., & Miller, E. K. (2012). A neural model of sequential movement planning and control of eye movements: Item-Order-Rank working memory and saccade selection by the supplementary eye fields. Neural Networks: the Official Journal of the International Neural Network Society, 26, 29-58.
[88] Simen, P., Cohen, J. D., & Holmes, P. (2006). Rapid decision threshold modulation by reward rate in a neural network. Neural Networks: the Official Journal of the International Neural Network Society, 19, 1013-1026. · Zbl 1103.68726
[89] Simen, P., Contreras, D., Buck, C., Hu, P., Holmes, P., & Cohen, J. D. (2009). Reward rate optimization in two-alternative decision making: empirical tests of theoretical predictions. Journal of Experimental Psychology. Human Perception and Performance, 35, 1865-1897.
[90] Smith, P. L., & Ratcliff, R. (2004). Psychology and neurobiology of simple decisions. Trends in Neurosciences, 27, 161-168.
[91] Song, P., & Wang, X. J. (2005). Angular Path Integration by Moving “Hill of Activity”: A Spiking Neuron Model without Recurrent Excitation of the Head-Direction System. Journal of Neuroscience, 25, 1002-1014.
[92] Standage, D., You, H., Wang, D. H., & Dorris, M. C. (2011). Gain modulation by an urgency signal controls the speed-accuracy trade-off in a network model of a cortical decision circuit. Frontiers in Computational Neuroscience, 5, 7.
[93] Stanford, T. R., Shankar, S., Massoglia, D. P., Costello, M. G., & Salinas, E. (2010). Perceptual decision making in less than 30 milliseconds. Nature Neuroscience, 13, 379-385.
[94] Swensson, R. G. (1972). The elusive tradeoff: speed versus accuracy in visual discrimination tasks. Perception & Psychophysics, 12, 16-32.
[95] Theodoni, P., Kovacs, G., Greenlee, M. W., & Deco, G. (2011a). Neuronal adaptation effects in decision making. Journal of Neuroscience, 31, 234-246.
[96] Theodoni, P., Panagiotaropoulos, T. I., Kapoor, V., Logothetis, N. K., & Deco, G. (2011b). Cortical microcircuit dynamics mediating binocular rivalry: the role of adaptation in inhibition. Frontiers in Human Neuroscience, 5, 145.
[97] Usher, M., & McClelland, J. L. (2001). The time course of perceptual choice: the leaky, competing accumulator model. Psychological Review, 108, 550-592.
[98] Wald, A. (1947). Sequential analysis. New York: Wiley. · Zbl 0041.26303
[99] Wald, A., & Wolfowitz, J. (1948). Optimum character of the sequential probability ratio test. Annals of Mathematical Statistics, 19, 326-339. · Zbl 0032.17302
[100] Wang, X. J. (2001). Synaptic reverberation underlying mnemonic persistent activity. Trends in Neurosciences, 24, 455-463.
[101] Wang, X. J. (2002). Probabilistic decision making by slow reverberation in cortical circuits. Neuron, 36, 955-968.
[102] Wong, K. F., & Wang, X. J. (2006). A recurrent network mechanism of time integration in perceptual decisions. The Journal of Neuroscience: the Official Journal of the Society for Neuroscience, 26, 1314-1328.
[103] Wong, K. F., Huk, A. C., Shadlen, M. N., & Wang, X. J. (2007). Neural circuit dynamics underlying accumulation of time-varying evidence during perceptual decision making. Frontiers in Computational Neuroscience, 1, 6.
[104] Yoshida, T., & Katz, D. B. (2011). Control of prestimulus activity related to improved sensory coding within a discrimination task. The Journal of Neuroscience: the Official Journal of the Society for Neuroscience, 31, 4101-4112.
[105] Zhang, K. (1996). Representation of spatial orientation by the intrinsic dynamics of the head-direction cell ensemble: a theory. The Journal of Neuroscience: the Official Journal of the Society for Neuroscience, 16, 2112-2126.
[106] Zhang, J., & Bogacz, R. (2010). Bounded Ornstein-Uhlenbeck models for two-choice time controlled tasks. Journal of Mathematical Psychology, 54, 322-333. · Zbl 1231.91390
[107] Zhang, J., Bogacz, R., & Holmes, P. (2009). A comparison of bounded diffusion models for choice in time controlled tasks. Journal of Mathematical Psychology, 53, 231-241. · Zbl 1176.60075
[108] Zhou, X., Wong-Lin, K., & Philip, H. (2009). Time-varying perturbations can distinguish among integrate-to-threshold models for perceptual decision making in reaction time tasks. Neural Computation, 21, 2336-2362. · Zbl 1168.91515
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.