Associative dynamics in a chaotic neural network. (English) Zbl 1423.68396
Summary: An associative network is constructed with chaotic neuron models interconnected through a conventional auto-associative matrix of synaptic weights. The associative dynamics of the network is analysed with spatio-temporal output patterns, quasi-energy function, distances between internal state vectors and orbital instability. The network shows a periodic response after a nonperiodic transient phase when the external stimulations are spatially constant. The retrieval characteristics and the duration in the transient phase are dependent on the initial conditions. The results imply that the transient dynamics can be interpreted as a memory searching process. The network also shows periodic responses with short and very long periods when external stimulations are not spatially constant, but corresponding to a stored pattern and an unstored pattern, respectively. The responses to the external stimulations can be utilized for a pattern recognition with nonlinear dynamics.
MSC:
| 68T10 | Pattern recognition, speech recognition |
| 37D45 | Strange attractors, chaotic dynamics of systems with hyperbolic behavior |
| 92B20 | Neural networks for/in biological studies, artificial life and related topics |
References:
| [8] | Aihara, K.; Takabe, T.; Toyoda, M., Chaotic neural networks, Physics Letters A, 144, 333-340 (1990) |
| [9] | Amari, S., Characteristics of sparsely encoded associative memory, Neural Networks, 2, 451-457 (1989) |
| [10] | Anderson, J. A., A simple neural network generating interactive memory, Mathematical Biosciences, 14, 197-220 (1972) · Zbl 0255.92001 |
| [11] | Bak, P.; Tang, C.; Wiesenfield, K., Self-organized criticality, Physical Review A, 38, 1, 364-374 (1988) · Zbl 1230.37103 |
| [13] | Brindley, J.; Kapitaniak, T., Existence and characterization of strange nonchaotic attractors in nonlinear systems, Chaos, Solitons and Fractals, 1, 4, 323-337 (1991) · Zbl 0744.58045 |
| [14] | Caianiello, E. R., Outline of a theory of thought-processes and thinking machines, J. Theoretical Biology, 2, 204-235 (1961) |
| [15] | Chen, L.; Aihara, K., Chaotic simulated annealing by a neural network model with transient chaos, Neural Networks, 8, 915-930 (1995) |
| [18] | Freeman, W. J., Simulation of chaotic EEG patterns with a dynamic model of the olfactory system, Biological Cybernetics, 56, 139-150 (1987) |
| [19] | Freeman, W. J., Tutorial on neurobiology: from single neurons to brain chaos, International Journal of Bifurcation and Chaos, 2, 451-482 (1992) · Zbl 0900.92036 |
| [20] | Grebogi, C.; Ott, E.; Pelikan, S.; Yorke, J. A., Strange attractors that are not chaotic, Physica D, 13, 261 (1984) · Zbl 0588.58036 |
| [21] | Hopfield, J. J., Neural networks and physical systems with emergent collective computation abilities, Proceedings of National Academy of Sciences, USA, 79, 2445-2558 (1982) · Zbl 1369.92007 |
| [23] | Ikeda, K.; Otsuka, K.; Matsumoto, K., Maxwell-Bloch turbulence, Progress in Theoretical Physics Supplement, 99, 295-324 (1989) |
| [24] | Kaneko, K., Clustering, coding, switching, hierarchical ordering, and control in a network of chaotic elements, Physica D, 41, 137-172 (1990) · Zbl 0709.58520 |
| [25] | Kapitaniak, T., On strange nonchaotic attractors and their dimensions, Chaos, Solitons & Fractals, 1, 67-77 (1991) · Zbl 0739.58042 |
| [26] | Kohonen, T., Correlation matrix memories, IEEE Transactions, C-21, 353-359 (1972) · Zbl 0232.68027 |
| [27] | Langton, C. G., Computation at the edge of chaos: phase transitions and emergent computation, Physica D, 42, 12-37 (1990) |
| [28] | McCulloch, W. S.; Pitts, W., A logical calculus of the ideas immanent in neural nets, Bulletin of Mathematics and Biophysics, 5, 115-133 (1943) · Zbl 0063.03860 |
| [29] | Moore, C., Unpredictability and undecidability in dynamical systems, Physical Review Letters, 64, 2354-2357 (1990) · Zbl 1050.37510 |
| [30] | Nagumo, J.; Sato, S., On a response characteristic of a mathematical neuron model, Kybernetic, 10, 155-164 (1972) · Zbl 0235.92001 |
| [31] | Nakano, K., Associatron—a model of associative memory, IEEE Transactions, SMC-2, 381-388 (1972) |
| [32] | Nara, S.; Davis, P., Chaotic wandering and search in a cycle-memory neural network, Progress in Theoretical Physics, 88, 845-855 (1992) |
| [33] | Rand, D. A.; Wilson, H. B., Chaotic stochasticity: a ubiquitous source of unpredictability in epidemics, Proceedings of Royal Society of London B, 246, 179-184 (1991) |
| [34] | Rumelhart, D. E.; Hinton, G. E.; Williams, R. J., Learning representations by back-propagating errors, Nature, 323, 533-536 (1986) · Zbl 1369.68284 |
| [35] | Shiino, M.; Fukai, T., Chaotic image retrieval in Markovian asymmetric neural networks with sign-constrained synaptic couplings, Journal of Physical Society of Japan, 59, 5, 1529-1532 (1990) |
| [36] | Shimada, I.; Nagashima, T., A numerical approach to ergodic problem of dissipative dynamical systems, Progress of Theoretical Physics, 61, 1605-1616 (1979) · Zbl 1171.34327 |
| [37] | Skarda, C. A.; Freeman, W. J., How brains make chaos in order to make sense of the world, Behavioral and Brain Science, 10, 161-195 (1987) |
| [39] | Tani, J.; Fujita, M., Coupling of memory search and mental rotation by a nonequilibrium dynamics neural network, IEICE Transactions on Fundamentals, E75-A, 578-585 (1992) |
| [41] | Tsuda, I., Chaotic itinerancy as a dynamical basis of hermeneutics in brain and mind, World Futures, 32, 167-184 (1991) |
| [42] | Tsuda, I., Dynamic link of memory—Chaotic memory map in nonequilibrium neural networks, Neural Networks, 5, 313-326 (1992) |
| [44] | Wigström, H., A neuron model with learning capability and its relation to mechanism of association, Kybernetic, 12, 204-215 (1973) · Zbl 0256.92007 |
| [45] | Wolf, A.; Swift, J. B.; Swinney, H. L.; Vastano, J. A., Determining Lyapunov exponents from a time series, Physica, 16D, 285-317 (1985) · Zbl 0585.58037 |
| [46] | Yao, Y.; Freeman, W. J., Model of biological pattern recognition with spatial chaotic dynamics, Neural Networks, 3, 153-170 (1990) |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
