×

A minimal model of the interaction of social and individual learning. (English) Zbl 1470.92020

Summary: Learning is thought to be achieved by the selective, activity dependent, adjustment of synaptic connections. Individual learning can also be very hard and/or slow. Social, supervised, learning from others might amplify individual, possibly mainly unsupervised, learning by individuals, and might underlie the development and evolution of culture. We studied a minimal neural network model of the interaction of individual, unsupervised, and social supervised learning by communicating “agents”. Individual agents attempted to learn to track a hidden fluctuating “source”, which, linearly mixed with other masking fluctuations, generated observable input vectors. In this model data are generated linearly, facilitating mathematical analysis. Learning was driven either solely by direct observation of input data (unsupervised, Hebbian) or, in addition, by observation of another agent’s output (supervised, Delta rule). To make learning more difficult, and to enhance biological realism, the learning rules were made slightly connection-inspecific, so that incorrect individual learning sometimes occurs. We found that social interaction can foster both correct and incorrect learning. Useful social learning therefore presumably involves additional factors some of which we outline.

MSC:

92B20 Neural networks for/in biological studies, artificial life and related topics
91D15 Social learning

References:

[1] Atakulreka, A., Sutivong, D., 2007. Avoiding local minima in feedforward neural networks by simultaneous learning. In: Orgun, M.A., Thornton, J. (Eds.), AI 2007: Advances in Artificial Intelligence: 20th Australian Joint Conference on Artificial Intelligence, Gold Coast, Australia, December 2-6, 2007. Proceedings. Springer Berlin Heidelberg, Berlin, Heidelberg, pp. 100-109.
[2] Bartol, T.M., Bromer, C., Kinney, J., Chirillo, M.A., Bourne, J.N., Harris, K.M., Sejnowski, T.J., 2015. Nanoconnectomic upper bound on the variability of synaptic plasticity. eLife 4, e10778, doi: 10.7554/eLife.10778.
[3] Baum, E. B., What is Thought? (2004), MIT Press
[4] Bell, A. J.; Sejnowski, T. J., The “independent components” of natural scenes are edge filters, Vision Res., 37, 3327-3338 (1997)
[5] Bengio, Y., Learning deep architectures for AI, Found. Trends Mach. Learn., 2, 1-127 (2009) · Zbl 1192.68503
[6] Bengio, Y., Evolving culture vs local minima, Stud. Comput. Intell., 557 (2012)
[7] Boyd, R.; Richerson, P. J., Why does culture increase human adaptability?, Ethol. Sociobiol., 16, 125-143 (1995)
[8] Boyd, R.; Richerson, P. J.; Henrich, J., The cultural niche: Why social learning is essential for human adaptation, Proc. Natl. Acad. Sci., 108, 10918-10925 (2011)
[9] Chen, S. S.; Gopinath, R. A., Gaussianization. NIPS, 2000, 6 (2000)
[10] Cichocki, A.; Chen, T.; Amari, S., Stability analysis of learning algorithms for blind source separation, Neural Netw., 10, 1345-1351 (1997)
[11] Cox, K. J.; Adams, P. R., Hebbian crosstalk prevents nonlinear unsupervised learning, Front. Comput. Neurosci., 3, 11 (2009)
[12] Cox, K. J.; Adams, P. R., Hebbian learning from higher-order correlations requires crosstalk minimization, Biol. Cybern., 108, 405-422 (2014)
[13] Curran, D., O’ Riordan, C., 2007. The Effects of cultural learning in populations of neural networks. Artificial Life 13, 45-67. doi:10.1162/artl.2007.13.1.45.
[14] Denaro, D., Parisi, D., 1997. Cultural evolution in a population of neural networks. In: Marinaro M., T. R. e., (Ed.), In: Neural Nets WIRN VIETRI-96. Perspectives in Neural Computing. Springer, London.
[15] Elliott, T., Cross-talk induces bifurcations in nonlinear models of synaptic plasticity, Neural Comput., 24, 1-68 (2012) · Zbl 1237.92012
[16] Engert, F.; Bonhoeffer, T., Synapse specificity of long-term potentiation breaks down at short distances, Nature, 388, 279-284 (1997)
[17] Erhan, D.; Bengio, Y.; Courville, A.; Manzagol, P.-A.; Vincent, P.; Bengio, S., Why does unsupervised pre-training help deep learning?, J. Mach. Learn. Res., 11, 625-660 (2010) · Zbl 1242.68219
[18] Field, D., What the statistics of natural images tell us about visual coding, SPIE, 1077, 7 (1989)
[19] Gabora, L., 1995. Meme and Variations: A Computational Model of Cultural Evolution. In L. Nadel and D. L. Stein (Eds.), 1993 Lectures in complex systems (pp. 471-486). Boston: Addison Wesley. (1995) Cite as:arXiv:1309.7524 [cs.MA].
[20] Gabora, L., Creativity: linchpin in the quest for a viable theory of cultural evolution, Curr. Opin. Behav. Sci., 27, 77-83 (2019)
[21] Gabora, L.; Steel, M., Autocatalytic networks in cognition and the origin of culture, J. Theor. Biol., 431 (2017) · Zbl 1388.92014
[22] Gabora, L.; Tseng, S., The social benefits of balancing creativity and imitation: evidence from an agent-based model, Psychol. Aesthetics Creativity Arts, 11, 403-419 (2017)
[23] Gabora, L.; Steel, M., Modeling a cognitive transition at the origin of cultural evolution using autocatalytic networks, Cogn. Sci., 44, e12878 (2020)
[24] Galef, B. G.; Laland, K. N., Social learning in animals: empirical studies and theoretical models, BioScience, 55, 489-499 (2005)
[25] Harvey, C. D.; Svoboda, K., Locally dynamic synaptic learning rules in pyramidal neuron dendrites, Nature, 450, 1195-1200 (2007)
[26] Henrich, J.; Boyd, R., On modeling cognition and culture: why cultural evolution does not require replication of representations, J. Cogn. Cult., 2, 87-112 (2002)
[27] Henrich, J.; Boyd, R.; Richerson, P., Five misunderstandings about cultural evolution, Hum. Nat., 19, 119-137 (2008)
[28] Heyes, C., Enquire within: cultural evolution and cognitive science, Philos. Trans. Royal Soc. B: Biol. Sci., 373, 20170051 (2018)
[29] Hinton, G. E., To recognize shapes, first learn to generate images, Prog. Brain Res., 165, 535-547 (2007)
[30] Hyvärinen, A.; Oja, E., Independent component analysis by general nonlinear Hebbian-like learning rules, Sign. Process., 64, 301-313 (1998) · Zbl 0893.94034
[31] Hyvärinen, A.; Karhunen, J.; Oja, E., Independent Component Analysis (2004), Wiley
[32] Jimenez, A. V.; Mesoudi, A., Prestige-biased social learning: current evidence and outstanding questions, Palgrave Commun., 5 (2019)
[33] Laparra, V.; Camps-Valls, G.; Malo, J., Iterative Gaussianization: from ICA to random rotations, IEEE Trans. Neural Netw., 4, 537-549 (2011)
[34] LeCun, Y.; Bengio, Y.; Hinton, G., Deep learning, Nature, 521, 436-444 (2015)
[35] Lyu, S.; Simoncelli, E. P., Nonlinear extraction of independent components of natural images using radial gaussianization, Neural Comput., 21, 1485-1519 (2009) · Zbl 1183.68692
[36] Marean, C. W., The origins and significance of coastal resource use in Africa and Western Eurasia, J. Hum. Evol., 77, 17-40 (2014)
[37] Marean, C. W., The transition to foraging for dense and predictable resources and its impact on the evolution of modern humans, Philos. Trans. R Soc. Lond. B Biol. Sci., 371 (2016)
[38] Nicholls, J. G.; Martin, A. R.; Brown, D. A.; Diamond, M. E.; Weisblat, D. A., From Neuron to Brain (2012), Sinauer Associates
[39] Radulescu, A.; Cox, K.; Adams, P., Hebbian errors in learning: an analysis using the Oja model, J. Theor. Biol., 258, 489-501 (2009) · Zbl 1402.92109
[40] Rădulescu, A.; Cox, K.; Adams, P., Hebbian errors in learning: an analysis using the Oja model, J. Theor. Biol., 258, 489-501 (2009) · Zbl 1402.92109
[41] Rattray, M., Stochastic trapping in a solvable model of on-line independent component analysis, Neural Comput., 14, 421-435 (2002) · Zbl 0993.68084
[42] Rendell, L.; Boyd, R.; Cownden, D.; Enquist, M.; Eriksson, K.; Feldman, M. W.; Fogarty, L.; Ghirlanda, S.; Lillicrap, T.; Laland, K. N., Why copy others? Insights from the social learning strategies tournament, Science, 328, 208-213 (2010) · Zbl 1226.91012
[43] Richerson, P. J.; Boyd, R., Not by Genes Alone: How Culture Transformed Human Evolution (2008), University of Chicago Press
[44] Rogers, A. R., Does biology constrain culture?, Am. Anthropol., 90, 819-831 (1988)
[45] Saxe, A. M.; McClelland, J. M.; Ganguli, S., Learning hierarchical category structure in deep neural networks, Proceedings of the Annual Meeting of the Cognitive Science Society 35 (2013)
[46] Sen, S.; Weiss, G., Learning in multiagent systems, (Gerhard, W., Multiagent systems (1999), MIT Press), 259-298
[47] Wessels, L. A.; Barnard, E., Avoiding false local minima by proper initialization of connections, IEEE Trans. Neural Netw., 3, 899-905 (1992)
[48] Widrow, B.; Hoff, M. E., Adaptive switching circuits, IRE WESCON Convention Record, 4, 96-104 (1960)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.