×

Genetically optimized fuzzy polynomial neural networks with fuzzy set-based polynomial neurons. (English) Zbl 1119.68159

Summary: We propose and investigate a new category of neurofuzzy networks – Fuzzy Polynomial Neural Networks (FPNN) endowed with Fuzzy Set-based Polynomial Neurons (FSPNs) We develop a comprehensive design methodology involving mechanisms of genetic optimization, and Genetic Algorithms (GAs) in particular. The conventional FPNNs developed so far are based on the mechanisms of self-organization, fuzzy neurocomputing, and evolutionary optimization. The design of the network exploits the FSPNs as well as the extended Group Method of Data Handling (GMDH). Let us stress that in the previous development strategies some essential parameters of the networks (such as the number of input variables, the order of the polynomial, the number of membership functions, and a collection of the specific subset of input variables) being available within the network are provided by the designer in advance and kept fixed throughout the overall development process. This restriction may hamper a possibility of developing an optimal architecture of the model. The design proposed in this study addresses this issue. The augmented and genetically developed FPNN (gFPNN) results in a structurally optimized structure and comes with a higher level of flexibility in comparison to the one we encounter in the conventional FPNNs. The GA-based design procedure being applied at each layer of the FPNN leads to the selection of the most suitable nodes (or FSPNs) available within the FPNN. In the sequel, two general optimization mechanisms are explored. First, the structural optimization is realized via GAs whereas the ensuing detailed parametric optimization is carried out in the setting of a standard least square method-based learning. The performance of the gFPNN is quantified through experimentation in which we use a number of modeling benchmarks–synthetic and experimental data being commonly used in fuzzy or neurofuzzy modeling. The obtained results demonstrate the superiority of the proposed networks over the models existing in the references.

MSC:

68P15 Database theory
68P20 Information storage and retrieval of data
68T05 Learning and adaptive systems in artificial intelligence

Software:

Genocop; ANFIS
Full Text: DOI

References:

[1] Cherkassky, V.; Gehring, D.; Mulier, F., Comparison of adaptive methods for function estimation from samples, IEEE Trans. Neural Networks, 7, July, 969-984 (1996)
[2] Cordón, O.; Gomide, F.; Herrera, F.; Hoffmann, F.; Magdalena, L., Ten years of genetic fuzzy systems: current framework and new trends, Fuzzy Sets Systems, 141, 1, 5-31 (2004) · Zbl 1050.93513
[3] Crowder, R. S., Predicting the Mackey-Glass time series with cascade-correlation learning, (Touretzky, D.; Hinton, G.; Sejnowski, T., Proceedings of the 1990 Connectionist Models Summer School (1990), Carnegie Mellon University), 117-123
[4] Dickerson, J. A.; Kosko, B., Fuzzy function approximation with ellipsoidal rules, IEEE Trans. Syst., Man, Cybernet., Part B, 26, Aug, 542-560 (1996)
[5] Gomez-Skarmeta, A. F.; Delgado, M.; Vila, M. A., About the use of fuzzy clustering techniques for fuzzy model identification, Fuzzy Sets Systems, 106, 179-188 (1999)
[6] Jang, J. S.R., ANFIS: Adaptive-network-based fuzzy inference system, IEEE Trans. System, Man, Cybern., 23, 3, 665-685 (1993)
[7] Jong, D., Are genetic algorithms function optimizers?, (Manner, R.; Manderick, B., Parallel Problem Solving from Nature, vol. 2 (1992), North-Holland: North-Holland Amsterdam), 3-14
[8] Kim, E.-T., A new approach to fuzzy modeling, IEEE Trans. Fuzzy Syst., 5, 3, 328-337 (1997)
[9] Kim, E.-T., A simple identified Sugeno-type fuzzy model via double clustering, Informat. Sci., 110, 25-39 (1998)
[10] Kleinsteuber, S.; Sepehri, N., A polynomial network modeling approach to a class of large-scale hydraulic systems, Comput. Electron. Eng., 22, 151-168 (1996)
[11] A.S. Lapedes, R. Farber, Non-linear signal processing using neural networks: prediction and system modeling, Technical Report LA-UR-87-2662, Los Alamos National Laboratory, Los Alamos, New Mexico 87545, 1987.; A.S. Lapedes, R. Farber, Non-linear signal processing using neural networks: prediction and system modeling, Technical Report LA-UR-87-2662, Los Alamos National Laboratory, Los Alamos, New Mexico 87545, 1987.
[12] Li, C. J.; Huang, T.-Y., Automatic structure and parameter training methods for modeling of mechanical systems by recurrent neural networks, Appl. Math. Model., 23, 933-944 (1999) · Zbl 1062.70614
[13] (Lyu, M. R., Handbook of Software Reliability Engineering (1995), McGraw-Hill: McGraw-Hill New York)
[14] Mackey, M. C.; Glass, L., Oscillation and chaos in physiological control systems, Science, 197, 287-289 (1977) · Zbl 1383.92036
[15] Maguire, L. P.; Roche, B.; McGinnity, T. M.; McDaid, L. J., Predicting a chaotic time series using a fuzzy neural network, Informat. Sci., 112, 125-136 (1998) · Zbl 0953.68590
[16] Michalewicz, Z., Genetic Algorithms + Data Structures = Evolution Programs (1996), Springer-Verlag: Springer-Verlag Berlin, Heidelberg · Zbl 0841.68047
[17] Oh, S.-K.; Kim, D.-W.; Park, B.-J.; Hwang, H.-S., Advanced polynomial neural networks architecture with new adaptive nodes, transactions on control, Automat. Syst. Eng., 3, 1, 43-50 (2001), (in Korean)
[18] Oh, S.-K.; Pedrycz, W., The design of self-organizing polynomial neural networks, Informat. Sci., 141, 237-258 (2002) · Zbl 1008.68098
[19] S.-K. Oh, W. Pedrycz, B.-J. Park, T.-C. Ahn, “A hybrid modeling architecture for software engineering, in: Proceedings of the 6th IASTED International Conference ASC, July 2002, pp. 309-314.; S.-K. Oh, W. Pedrycz, B.-J. Park, T.-C. Ahn, “A hybrid modeling architecture for software engineering, in: Proceedings of the 6th IASTED International Conference ASC, July 2002, pp. 309-314.
[20] Oh, S.-K.; Pedrycz, W.; Ahn, T.-C., Self-organizing neural networks with fuzzy polynomial neurons, Appl. Soft Comput., 2, 1, 1-10 (2002)
[21] Oh, S.-K.; Pedrycz, W., Fuzzy polynomial neuron-based self-organizing neural networks, Int. J. General Syst., 32, 3, 237-250 (2003) · Zbl 1036.93039
[22] Oh, S.-K.; Pedrycz, W.; Park, B.-J., Polynomial neural networks architecture: analysis and design, Comput. Elect. Eng., 29, 6, 703-725 (2003)
[23] Oh, S.-K.; Pedrycz, W., Self-organizing polynomial neural networks based on PNS or FPNS: analysis and design, Fuzzy Sets Syst., 142, 2, 163-198 (2004) · Zbl 1091.68095
[24] Oh, S.-K.; Pedrycz, W.; Park, B.-J., Relation-based neurofuzzy networks with evolutionary data granulation, Math. Comput. Modell., 40, 7-8, 891-921 (2004) · Zbl 1067.92006
[25] Park, B.-J.; Pedrycz, W.; Oh, S.-K., Fuzzy Polynomial neural networks : hybrid architectures of fuzzy modeling, IEEE Trans. Fuzzy Syst., 10, 5, 607-621 (2002)
[26] Sommer, V.; Tobias, P.; Kohl, D.; Sundgren, H.; Lundstrom, L., Neural networks and abductive networks for chemical sensor signals: A case comparison, Sensors Actuators B, 28, 217-222 (1995)
[27] Sugeno, M.; Yasukawa, T., A fuzzy-logic-based approach to qualitative modeling, IEEE Trans. Fuzzy Syst., 1, 1, 7-31 (1993)
[28] Wang, L. X.; Mendel, J. M., Generating fuzzy rules from numerical data with applications, IEEE Trans. Syst., Man, Cybernet., 22, 6, 1414-1427 (1992)
[29] Zadeh, L. A., Toward a generalized theory of uncertainty (GTU)—an outline, Inform. Sci., 172, 1-2, 1-40 (2005) · Zbl 1074.94021
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.