Observer-based dynamical pattern recognition via deterministic learning. (English) Zbl 07752040
Summary: In this paper, based on the sampled-data observer and the deterministic learning theory, a rapid dynamical pattern recognition approach is proposed for univariate time series composed of the output signals of the dynamical systems. Specifically, locally-accurate identification of inherent dynamics of univariate time series is first achieved by using the sampled-data observer and the radial basis function (RBF) networks. The dynamical estimators embedded with the learned knowledge are then designed by resorting to the sampled-data observer. It is proved that generated estimator residuals can reflect the difference between the system dynamics of the training and test univariate time series. Finally, a recognition decision-making scheme is proposed based on the residual norms of the dynamical estimators. Through rigorous analysis, recognition conditions are given to guarantee the accurate recognition of the dynamical pattern of the test univariate time series. The significance of this paper lies in that the difficult problems of dynamical modeling and rapid recognition for univariate time series are solved by incorporating the sampled-data observer design and the deterministic learning theory. The effectiveness of the proposed approach is confirmed by a numerical example and compressor stall warning experiments.
MSC:
| 68T10 | Pattern recognition, speech recognition |
Keywords:
dynamical pattern recognition; deterministic learning; observer; radial basis function network; univariate time seriesReferences:
| [1] | Aydin, I.; Karakose, M.; Akin, E., Learning dynamical systems in noise using convolutional neural networks, Chaos, 30, 10, Article 103125 pp. (2020) · Zbl 1451.37103 |
| [2] | Bin, M.; Marconi, L., Model identification and adaptive state observation for a class of nonlinear systems, IEEE Transactions on Automatic Control, 66, 12, 5621-5636 (2021) · Zbl 1536.93153 |
| [3] | Chen, W.; Shi, K., Multi-scale Attention Convolutional Neural Network for time series classification, Neural Networks, 136, 126-140 (2021) |
| [4] | Chen, T.; Zeng, C.; Wang, C., Fault identification for a class of nonlinear systems of canonical form via deterministic learning, IEEE Transactions on Cybernetics, 52, 10, 10957-10968 (2022) |
| [5] | Christensen, D.; Cantin, P.; Gutz, D., Development and demonstration of a stability management system for gas turbine engines, Journal of Turbomachinery, 130, 3, Article 031011 pp. (2008) |
| [6] | Covey, C.; Hawkins, H. L.; Port, R. F., Neural representation of temporal patterns (2012), Springer Science & Business Media: Springer Science & Business Media Berlin |
| [7] | El Assoudi, A.; El Yaagoubi, E. H.; Hammouri, H., Non-linear observer based on the Euler discretization, International Journal of Control, 75, 11, 784-791 (2002) · Zbl 1162.93320 |
| [8] | Eren-Oruklu, M.; Cinar, A.; Rollins, D. K.; Quinn, L., Adaptive system identification for estimating future glucose concentrations and hypoglycemia alarms, Automatica, 48, 8, 1892-1897 (2012) · Zbl 1267.93173 |
| [9] | Farrell, J. A.; Polycarpou, M. M., Adaptive approximation based control: Unifying neural, fuzzy and traditional adaptive approximation approaches (2006), John Wiley & Sons: John Wiley & Sons New York, USA |
| [10] | Fu, T., A review on time series data mining, Engineering Applications of Artificial Intelligence, 24, 1, 164-181 (2011) |
| [11] | Gharghabi, S., Imani, S., Bagnall, A., Darvishzadeh, A., & Keogh, E. (2018). Matrix profile xii: Mpdist: a novel time series distance measure to allow data mining in more challenging scenarios. In IEEE international conference on data mining (pp. 965-970). Singapore: http://dx.doi.org/10.1109/ICDM.2018.00119. · Zbl 1477.68264 |
| [12] | González-Olvera, M. A.; Tang, Y., Identification of nonlinear discrete systems by a state-space recurrent neurofuzzy network with a convergent algorithm, Neurocomputing, 148, 318-325 (2015) |
| [13] | Hazan, E.; Singh, K.; Zhang, C., Learning linear dynamical systems via spectral filtering, Advances in Neural Information Processing Systems, 30, 6702-6712 (2017) |
| [14] | Hu, J. T.; Wu, W. M.; Ji, B.; Wang, C., Observer design for sampled-data systems via deterministic learning, IEEE Transactions on Neural Networks and Learning Systems, 33, 7, 2931-2939 (2022) |
| [15] | Khalil, H. K., High-gain observers in nonlinear feedback control (2017), Society for Industrial and Applied Mathematics: Society for Industrial and Applied Mathematics Philadelphia, USA · Zbl 1380.93002 |
| [16] | Kim, Y. H.; Lewis, F. L.; Abdallah, C. T., A dynamic recurrent neural-network-based adaptive observer for a class of nonlinear systems, Automatica, 33, 8, 1539-1543 (1997) · Zbl 1047.93504 |
| [17] | Längkvist, M.; Karlsson, L.; Loutfi, A., A review of unsupervised feature learning and deep learning for time-series modeling, Pattern Recognition Letters, 42, 11-24 (2014) |
| [18] | Li, J.; Pedrycz, W.; Jamal, I., Multivariate time series anomaly detection: A framework of Hidden Markov Models, Applied Soft Computing, 60, 229-240 (2017) |
| [19] | Lin, P.; Wang, C.; Chen, T., A stall warning scheme for aircraft engines with inlet distortion via deterministic learning, IEEE Transactions on Control Systems Technology, 26, 4, 1468-1474 (2017) |
| [20] | Liu, Y.; Li, J. C.; Du, J., Reliability analysis for stall warning methods in an axial flow compressor, Aerospace Science and Technology, 115, Article 106816 pp. (2021) |
| [21] | Lu, S. Y.; Basar, T., Robust nonlinear system identification using neural-network models, IEEE Transactions on Neural Networks, 9, 3, 407-429 (1998) |
| [22] | Nar, K.; Sastry, S. S., Persistency of excitation for robustness of neural networks (2019), arXiv:1911.01043 |
| [23] | Nelles, O., Nonlinear system identification: From classical approaches to neural networks, fuzzy models, and gaussian processes (2020), Springer Nature · Zbl 1453.93001 |
| [24] | Ortega, R.; Nikiforov, V.; Gerasimov, D., On modified parameter estimators for identification and adaptive control. A unified framework and some new schemes, Annual Reviews in Control, 50, 278-293 (2020) |
| [25] | Ozturk, M. C.; Principe, J. C., An associative memory readout for ESNs with applications to dynamical pattern recognition, Neural Networks, 20, 3, 377-390 (2007) · Zbl 1132.68654 |
| [26] | Paduano, J. D., Analysis of compression system dynamics, Active Control of Engine Dynamics, 8, 1-36 (2002) |
| [27] | Park, J.; Sandberg, I. W., Universal approximation using radial-basis-function networks, Neural Computation, 3, 2, 246-257 (1991) |
| [28] | Pei, W.; Dibeklioğlu, H., Multivariate time-series classification using the hidden-unit logistic model, IEEE Transactions on Neural Networks and Learning Systems, 29, 4, 920-931 (2018) |
| [29] | Racca, A.; Magri, L., Robust Optimization and Validation of Echo State Networks for learning chaotic dynamics, Neural Networks, 142, 252-268 (2021) · Zbl 1521.68153 |
| [30] | Rugh, W. J., Linear system theory (1996), Prentice-Hall, Inc.: Prentice-Hall, Inc. Hoboken, NJ, USA · Zbl 0892.93002 |
| [31] | Ruiz, A. P.; Flynn, M.; Large, J., The great multivariate time series classification bake off: a review and experimental evaluation of recent algorithmic advances, Data Mining and Knowledge Discovery, 35, 2, 401-449 (2021) · Zbl 1478.62267 |
| [32] | Schoukens, J.; Ljung, L., Nonlinear system identification: A user-oriented road map, IEEE Control Systems Magazine, 39, 6, 28-99 (2019) · Zbl 1477.93167 |
| [33] | Seshagiri, S.; Khalil, H. K., Output feedback control of nonlinear systems using RBF neural networks, IEEE Transactions on Neural Networks, 11, 1, 69-79 (2000) |
| [34] | Sun, J. C.; Yang, Y., Univariate time series classification using information geometry, Pattern Recognition, 95, 24-35 (2019) |
| [35] | Venkataraman, V.; Turaga, P., Shape distributions of nonlinear dynamical systems for video-based inference, IEEE Transactions on Pattern Analysis and Machine Intelligence, 38, 12, 2531-2543 (2016) |
| [36] | Wang, D. L.; Freeman, W. J.; Kozma, R., Special issue on temporal coding for neural information processing, IEEE Transactions on Neural Networks, 15, 5, 164-181 (2004) |
| [37] | Wang, C.; Hill, D. J., Learning from neural control, IEEE Transactions on Neural Networks, 17, 1, 130-146 (2006) |
| [38] | Wang, C.; Hill, D. J., Deterministic learning and rapid dynamical pattern recognition, IEEE Transactions on Neural Networks, 18, 3, 617-630 (2007) |
| [39] | Wang, C.; Hill, D. J., Deterministic learning theory for identification, recognition, and control (2009), CRC Press: CRC Press Boca Raton, FL |
| [40] | Wang, C.; Hill, D. J., Deterministic learning and nonlinear observer design, Asian Journal of Control, 12, 6, 714-724 (2010) |
| [41] | Wang, C.; Hill, D. J., Rapid detection of small oscillation faults via deterministic learning, IEEE Transactions on Neural Networks, 22, 8, 1284-1296 (2011) |
| [42] | Wang, C.; Si, W. J.; Wen, B. H., Modeling and detection of rotating stall in axial flow compressors, II: Experimental study for low-speed compressor in Beihang University, Control Theory & Applications, 31, 10, 1414-1422 (2014) |
| [43] | Wu, W. M.; Wang, C.; Yuan, C. Z., Deterministic learning from sampling data, Neurocomputing, 358, 456-466 (2019) |
| [44] | Wu, W. M.; Wang, Q.; Yuan, C. Z.; Wang, C., Rapid dynamical pattern recognition for sampling sequences, Science China. Information Sciences, 64, 3, 1-18 (2021) |
| [45] | Xing, Z.; Pei, J.; Yu, P. S.; Wang, K., Extracting interpretable features for early classification on time series, (SIAM International conference on data mining (2011)), 247-258 |
| [46] | Yu, W., & Poznyak, A. S. (1999). System identification with partial-state measurement via dynamic multilayer neural networks. In International joint conference on neural networks (pp. 2081-2086). Washington, DC, USA: http://dx.doi.org/10.1109/IJCNN.1999.832707. |
| [47] | Yuan, C.; Wang, C., Persistency of excitation and performance of deterministic learning, Systems & Control Letters, 60, 12, 952-959 (2011) · Zbl 1231.93026 |
| [48] | Zeng, W.; Wang, C., Human gait recognition via deterministic learning, Neural Networks, 35, 92-102 (2012) |
| [49] | Zeng, W.; Wang, Q.; Liu, F.; Wang, Y., Learning from adaptive neural network output feedback control of a unicycle-type mobile robot, ISA Transactions, 61, 337-347 (2016) |
| [50] | Zhang, J., Study of a new method for giving warning signals of instability, Journal of Aerospace Power, 19, 2, 270-277 (2004) |
| [51] | Zheng, T.; Wang, C., Relationship between persistent excitation levels and RBF network structures, with application to performance analysis of deterministic learning, IEEE Transactions on Cybernetics, 47, 10, 3380-3392 (2017) |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
