×

Free-lunch learning: modeling spontaneous recovery of memory. (English) Zbl 1117.91049

Summary: After a language has been learned and then forgotten, relearning some words appears to facilitate spontaneous recovery of other words. More generally, relearning partially forgotten associations induces recovery of other associations in humans, an effect we call free-lunch learning (FLL). Using neural network models, we prove that FLL is a necessary consequence of storing associations as distributed representations. Specifically, we prove that (1) FLL becomes increasingly likely as the number of synapses (connection weights) increases, suggesting that FLL contributes to memory in neurophysiological systems, and (2) the magnitude of FLL is greatest if inactive synapses are removed, suggesting a computational role for synaptic pruning in physiological systems. We also demonstrate that FLL is different from generalization effects conventionally associated with neural network models. As FLL is a generic property of distributed representations, it may constitute an important factor in human memory.

MSC:

91E40 Memory and learning in psychology
92C20 Neural biology
Full Text: DOI

References:

[1] DOI: 10.1007/s004269900015 · doi:10.1007/s004269900015
[2] DOI: 10.1080/095400998116521 · doi:10.1080/095400998116521
[3] DOI: 10.1098/rspb.2002.2103 · doi:10.1098/rspb.2002.2103
[4] DOI: 10.1207/s15516709cog2301_3 · doi:10.1207/s15516709cog2301_3
[5] DOI: 10.1016/S0893-6080(99)00046-5 · doi:10.1016/S0893-6080(99)00046-5
[6] Goldin M., J. Neuroscience 21 (1) pp 186– (2001)
[7] DOI: 10.1162/089976602320264079 · Zbl 1011.92014 · doi:10.1162/089976602320264079
[8] DOI: 10.1162/neco.1996.8.4.697 · doi:10.1162/neco.1996.8.4.697
[9] Hinton G., Seattle WA pp 177– (1987)
[10] DOI: 10.1016/S0896-6273(03)00869-9 · doi:10.1016/S0896-6273(03)00869-9
[11] DOI: 10.1126/science.7414326 · doi:10.1126/science.7414326
[12] DOI: 10.1038/nature02581 · doi:10.1038/nature02581
[13] DOI: 10.1038/35102676 · doi:10.1038/35102676
[14] Sutton R., Machine Learning 3 pp 9– (1988)
[15] DOI: 10.1080/026432996382033 · doi:10.1080/026432996382033
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.