×

Multiple discriminant preserving support subspace RBFNNs with graph similarity learning. (English) Zbl 07834417

Summary: In a high-dimensional sample space, the distribution characteristics of samples are complex. It is difficult to accurately describe the local distribution characteristics of samples directly in the original sample space. This paper proposes a multiple discriminant preserving support subspace radial basis function neural networks with graph similarity learning (DPSS-RBFNN) to describe the distribution characteristics of samples in the original high-dimensional space by multiple low-dimensional and simple discriminant preserving subspaces. DPSS-RBFNN includes the discriminant preserving support subspace (DPSS) learning module and the subspace distribution feature extraction (SDFE) module. In the DPSS learning module, the discriminativeness of each attribute and the joint discriminant between attributes are first considered to construct multiple subspaces. The discriminativeness of the features in these subspaces is not lower than that of the original samples. The graph similarity learning is used to measure the similarity of sample distributions between subspaces with different dimensions. Then multiple DPSSs are obtained. In SDFE module, the distribution characteristics of the samples are described by combining the local responses of the feature space extracted by the sub-RBFNN in each DPSS. The experimental results show that the proposed DPSS-RBFNN with few kernels can achieve higher accuracy in the recognition task than state-of-the-art algorithms.

MSC:

68-XX Computer science
62-XX Statistics

Software:

CMU PIE; UCI-ml
Full Text: DOI

References:

[1] Addeh, Abdoljalil; Khormali, Aminollah; Golilarz, Noorbakhsh Amiri, Control chart pattern recognition using rbf neural network with new training algorithm and practical features, ISA Trans., 79, 202-216 (2018)
[2] Adeli, Hojjat; Karim, Asim, Fuzzy-wavelet rbfnn model for freeway incident detection, J. Transp. Eng., 126, 6, 464-471 (2000)
[3] Bacha, Sawssen; Taouali, Okba, A novel machine learning approach for breast cancer diagnosis, Measurement, 187, Article 110233 pp. (2022)
[4] Cai, Lin; Rad, Ahmad B.; Chan, Wai-Lok, An intelligent longitudinal controller for application in semiautonomous vehicles, IEEE Trans. Industr. Electron., 57, 4, 1487-1497 (2009)
[5] Mingxiang Cai, Ouaer Hocine, Ahmed Salih Mohammed, Xiaoling Chen, Menad Nait Amar, and Mahdi Hasanipanah. Integrating the lssvm and rbfnn models with three optimization algorithms to predict the soil liquefaction potential. Engineering with Computers, pages 1-13, 2021.
[6] Chao, Zhen; Duan, Xingguang; Jia, Shuangfu; Guo, Xuejun; Liu, Hao; Jia, Fucang, Medical image fusion via discrete stationary wavelet transform and an enhanced radial basis function neural network, Appl. Soft Comput., 118, Article 108542 pp. (2022)
[7] Chen, S.; Cowan, C. F.N.; Grant, P. M., Orthogonal least squares learning algorithm for radial, IEEE Trans. Neural Networks, 2, 2, 303 (1991)
[8] Cybenko, George, Approximation by superpositions of a sigmoidal function, Math. Control Signals Syst., 2, 4, 303-314 (1989) · Zbl 0679.94019
[9] Dhanalakshmi, P.; Palanivel, S.; Ramalingam, Vennila, Classification of audio signals using svm and rbfnn, Expert Syst. Appl., 36, 3, 6069-6075 (2009)
[10] Dheeru Dua and Casey Graff. UCI machine learning repository, 2017.
[11] Gou, Jianping; Yang, Yuanyuan; Yi, Zhang; Lv, Jiancheng; Mao, Qirong; Zhan, Yongzhao, Discriminative globality and locality preserving graph embedding for dimensionality reduction, Expert Syst. Appl., 144, Article 113079 pp. (2020)
[12] Gou, Jianping; Yuan, Xia; Lan, Du.; Xia, Shuyin; Yi, Zhang, Hierarchical graph augmented deep collaborative dictionary learning for classification, IEEE Trans. Intell. Transp. Syst., 1-15 (2022)
[13] Xiang-Gui Guo, Meng-En Tian, Qing Li, Choon Ki Ahn, and Yan-Hua Yang. Multiple-fault diagnosis for spacecraft attitude control systems using rbfnn-based observers. Aerospace Sci. Technol. 106:106195, 2020.
[14] Han, Ziyang; Qian, Xusheng; Huang, He; Huang, Tingwen, Efficient design of multicolumn rbf networks, Neurocomputing, 450, 253-263 (2021)
[15] Simon Haykin. Neural networks and learning machines, 3/E. Pearson Education India, 2009.
[16] Hu, Yanxing; You, Jane Jia; Liu, James N. K.; He, Tiantian, An eigenvector based center selection for fast training scheme of rbfnn, Inf. Sci., 428, 62-75 (2018)
[17] Sunan Huang and Kok Kiong Tan. Fault detection and diagnosis based on modeling and estimation methods. IEEE Trans. Neural Networks 20(5):872-881, 2009.
[18] Javan, Dawood Seyed; Mashhadi, Habib Rajabi; Rouhani, Mojtaba, A fast static security assessment method based on radial basis function neural networks using enhanced clustering, Int. J. Electr. Power Energy Syst., 44, 1, 988-996 (2013)
[19] Lee, Yeon Ju; Yoon, Jungho, Nonlinear image upsampling method based on radial basis function interpolation, IEEE Trans. Image Process., 19, 10, 2682-2692 (2010) · Zbl 1371.94221
[20] Leonardis, Aleš; Bischof, Horst, An efficient mdl-based construction of rbf networks, Neural Networks, 11, 5, 963-973 (1998)
[21] Li, Qiude; Xiong, Qingyu; Ji, Shengfen; Yu, Yang; Wu, Chao; Yi, Hualing, A method for mixed data classification base on rbf-elm network, Neurocomputing, 431, 7-22 (2021)
[22] Xiang Ling, Lingfei Wu, Saizhuo Wang, Tengfei Ma, Fangli Xu, Alex X Liu, Chunming Wu, and Shouling Ji. Multilevel graph matching networks for deep graph similarity learning. IEEE Trans. Neural Networks Learn. Syst., pages 1-15, 2021.
[23] Yixin Liu, Ming Jin, Shirui Pan, Chuan Zhou, Yu Zheng, Feng Xia, and Philip Yu. Graph self-supervised learning: A survey. IEEE Trans. Knowl. Data Eng. (2022).
[24] Oh, Sung-Kwun; Kim, Wook-Dong; Pedrycz, Witold, Design of radial basis function neural network classifier realized with the aid of data preprocessing techniques: design and analysis, Int. J. Gen. Syst., 45, 4, 434-454 (2016) · Zbl 1347.62118
[25] Oyang, Yen-Jen; Hwang, Shien-Ching; Ou, Yu-Yen; Chen, Chien-Yu; Chen, Zhi-Wei, Data classification with radial basis function networks based on a novel kernel density estimation algorithm, IEEE Trans. Neural Networks, 16, 1, 225-236 (2005)
[26] Pang, Hui; Liu, Minhao; Hu, Chuan; Zhang, Fengqi, Adaptive sliding mode attitude control of two-wheel mobile robot with an integrated learning-based rbfnn approach, Neural Comput. Appl., 1-11 (2022)
[27] Rai, Hari Mohan; Chatterjee, Kalyan; Nayyar, Anand, Automatic segmentation and classification of brain tumor from mr images using dwt-rbfnn, (Advanced Soft Computing Techniques in Data Science, IoT and Cloud Computing (2021), Springer), 215-243
[28] Rouhani, Modjtaba; Javan, Dawood S., Two fast and accurate heuristic rbf learning rules for data classification, Neural Networks, 75, 150-161 (2016) · Zbl 1414.68071
[29] Sim, Terence; Baker, Simon; Bsat, Maan, The cmu pose, illumination and expression database of human faces (2001), Carnegie Mellon University Technical Report CMU-RI-TR-OI-02
[30] Tian, Jin; Li, Minqiang; Chen, Fuzan; Feng, Nan, Learning subspace-based rbfnn using coevolutionary algorithm for complex classification tasks, IEEE Trans. Neural Networks Learn. Syst., 27, 1, 47-61 (2015)
[31] Turk, Matthew; Pentland, Alex, Eigenfaces for recognition, J. Cogn. Neurosci., 3, 1, 71-86 (1991)
[32] Wang, Hao; Feng, Ruibin; Han, Zi-Fa; Leung, Chi-Sing, Admm-based algorithm for training fault tolerant rbf networks and selecting centers, IEEE Trans. Neural Networks Learn. Syst., 29, 8, 3870-3878 (2018)
[33] Wang, Ting; Ji, Xiangjun; Song, Aiguo; Madani, Kurosh; Chohra, Amine; Lu, Huimin; Monero, Ramon, Output-bounded and rbfnn-based position tracking and adaptive force control for security tele-surgery, ACM Trans. Multimidia Comput. Commun. Appl., 17, 2s, 1-15 (2021)
[34] Wu, Bo; Wu, Ke; Lü, JianHong, A novel compensation-based recurrent fuzzy neural network and its learning algorithm, Sci. China Ser. F: Inf. Sci., 52, 1, 41-51 (2009) · Zbl 1192.68546
[35] Wu, Sitao; Chow, Tommy W. S., Induction machine fault detection using som-based rbf neural networks, IEEE Trans. Industr. Electron., 51, 1, 183-194 (2004)
[36] Yang, Jian-Bo; Shen, Kai-Quan; Ong, Chong-Jin; Li, Xiao-Ping, Feature selection for mlp neural network: The use of random permutation of probabilistic outputs, IEEE Trans. Neural Networks, 20, 12, 1911-1922 (2009)
[37] Hao Yu, Philip D Reiner, Tiantian Xie, Tomasz Bartczak, and Bogdan M Wilamowski. An incremental design of radial basis function networks. IEEE Trans. Neural Networks Learn. Syst. 25(10):1793-1803, 2014.
[38] Yu, Qiongxia; Hou, Zhongsheng; Bu, Xuhui; Yu, Qiongfang, Rbfnn-based data-driven predictive iterative learning control for nonaffine nonlinear systems, IEEE Trans. Neural Networks Learn. Syst., 31, 4, 1170-1182 (2019)
[39] Yu, Xian; Hou, Zhongsheng; Polycarpou, Marios M., Controller-dynamic-linearization-based data-driven ilc for nonlinear discrete-time systems with rbfnn, IEEE Trans. Syst. Man Cybern.: Syst. (2021)
[40] Zhang, Wei; Li, Zhong; Xu, Weidong; Zhou, Haiquan, A classifier of satellite signals based on the back-propagation neural network, (2015 8th International Congress on Image and Signal Processing (CISP), IEEE (2015)), 1353-1357
[41] Zhao, Yang; Pei, Jihong; Chen, Hao, Multi-layer radial basis function neural network based on multi-scale kernel learning, Appl. Soft Comput., 82, Article 105541 pp. (2019)
[42] Zheng, Siming; Zhao, Yang; Pei, Jihong, Multi-subspace rbfnn driven by features correlation learning, (2021 4th International Conference on Algorithms, Computing and Artificial Intelligence (2021)), 1-5
[43] Zhu, Mingxun; Meng, Zhigang, Macroeconomic image analysis and gdp prediction based on the genetic algorithm radial basis function neural network (rbfnn-ga), Comput. Intell. Neurosci., 2021, 2000159 (2021)
[44] Zounemat-Kermani, Mohammad; Stephan, Dietmar; Barjenbruch, Matthias; Hinkelmann, Reinhard, Ensemble data mining modeling in corrosion of concrete sewer: A comparative study of network-based (mlpnn & rbfnn) and tree-based (rf, chaid, & cart) models, Adv. Eng. Inform., 43, Article 101030 pp. (2020)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.