Design methodology for radial basis function neural networks classifier based on locally linear reconstruction and conditional fuzzy C-means clustering. (English) Zbl 1456.68164
Summary: In this study, a new design method for Fuzzy Radial Basis Function Neural Networks classifier is proposed. The proposed approach is based on conditional Fuzzy C-Means clustering algorithm realized with the aid of auxiliary information, which is extracted by the locally linear reconstruction algorithm. Conditional Fuzzy C-Means can analyze the distribution of data (patterns) over the input space when being supervised by the auxiliary information. The conditional fuzzy C-Means clustering can substitute the conventional fuzzy C-Means clustering which has been usually used to define the radial basis functions over the input space. It is advocated that the auxiliary information extracted by using the locally linear reconstruction can determine which patterns among the entire data set are more important than the others. This assumption is based on the observation that the data, which cannot be fully reconstructed by the linear combination of their neighbors, may convey much more information than the other data to be reconstructed. It is well known that in the case of radial basis function neural networks classifier, the classification performance of this classifier is predominantly based on the distribution of the radial basis function over the input space. Several experiments are provided to verify the proposed design method for classification problems.
MSC:
| 68T05 | Learning and adaptive systems in artificial intelligence |
| 62H30 | Classification and discrimination; cluster analysis (statistical aspects) |
Keywords:
conditional fuzzy C-means clustering; fuzzy radial basis function neural networks; auxiliary information; locally linear reconstruction; outlier detectionReferences:
| [1] | Jang, J.-S. R.; Sun, C.-T.; Mizutani, E., Neuro-Fuzzy and Soft Computing: A Computational Approach to Learning and Machine Intelligence (1997), Prentice-Hall: Prentice-Hall Englewood Cliffs, NJ |
| [2] | Li, W.; Hori, Y., An algorithm for extracting fuzzy rules based on RBF neural network, IEEE Trans. Ind. Electron., 53, 4, 1269-1276 (2006) |
| [3] | Pedrycz, W., Conditional fuzzy clustering in the design of radial basis function neural networks, IEEE Trans. Neural Netw., 9, 4, 601-612 (1998) |
| [4] | Tsekourasa, G.; Sarimveisb, H.; Kavaklia, E.; Bafasb, G., A hierarchical fuzzy-clustering approach to fuzzy modeling, Fuzzy Sets Syst., 150, 2, 245-266 (2005) · Zbl 1142.93311 |
| [5] | Ng, W. W.Y.; Dorado, A.; Yeung, D. S.; Pedrycz, W.; Izquierdo, E., Image classification with the use of radial basis function neural networks and the minimization of the localized generalization error, Pattern Recognit., 40, 19-32 (2007) · Zbl 1103.68942 |
| [6] | Park, B. J.; Pedrycz, W.; Oh, S. K., Polynomial-based radial basis function neural networks (P-RBFNNs) and their application to pattern classification, Appl. Intell., 32, 1, 27-46 (2008), [24]; Pedrycz, W., Conditional fuzzy C-means, Pattern Recognit. Lett., 17, 6, 625-632 (1996) |
| [7] | Pedrycz, W., Conditional fuzzy clustering in the design of radial basis function neural networks, IEEE Trans. Neural Netw., 9, 4, 601-612 (1998) |
| [8] | Pedrycz, W.; Park, H. S.; Oh, S. K., A granular-oriented development of functional radial basis function neural networks, Neurocomputing, 72, 420-435 (2008) |
| [9] | Renjifo, C.; Barsic, D.; Carmen, C.; Norman, K.; Peacock, G. S., Improving radial basis function kernel classification through incremental learning and automatic parameter selection, Neurocomputing, 72, 3-14 (2008) |
| [10] | Rocha, M.; Cortez, P.; Neves, J., Simultaneous evolution of neural network topologies and weights for classification and regression, (Computational Intelligence and Bioinspired Systems: 8th Int. Workshop on Artificial Neural Networks. Computational Intelligence and Bioinspired Systems: 8th Int. Workshop on Artificial Neural Networks, Lect. Notes Comput. Sci., vol. 3512 (2005)), 59-66 |
| [11] | Ros, F.; Pintore, M.; Chretien, J. R., Automatic design of growing radial basis function neural networks based on neighborhood concepts, Chemom. Intell. Lab. Syst., 87, 231-240 (2007) |
| [12] | Senapati, M. R.; Vijaya, I.; Dash, P. K., Rule extraction from radial basis functional neural networks by using particle swarm optimization, J. Comput. Sci., 3, 8, 592-599 (2007) |
| [13] | Staiano, A.; Tagliaferri, R.; Pedrycz, W., Improving RBF networks performance in regression tasks by means of a supervised fuzzy clustering, Neurocomputing, 69, 13-15, 1570-1581 (2006) |
| [14] | Liu, Yuanhong; Zhang, Yansheng; Yu, Zhiwei; Zeng, Ming, Incremental supervised locally linear embedding for machinery fault diagnosis, Eng. Appl. Artif. Intell., 50, 60-70 (2016) |
| [15] | Huang, W.; Oh, Sung-Kwun, Optimized polynomial neural network classifier designed with the aid of space search simultaneous tuning strategy and data preprocessing techniques, J. Electr. Eng. Technol., 12, 2, 911-917 (2017) |
| [16] | Frank, E.; Hall, M. A.; Witten, T. H., Data Mining: Practical Machine Learning Tools and Techniques (2016), Morgan Kaufman |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
