×

A new approach to self-organizing fuzzy polynomial neural networks guided by genetic optimization. (English) Zbl 1345.92015

Summary: We introduce a new topology of Fuzzy Polynomial Neural Networks (FPNN) that is based on a genetically optimized multilayer perceptron with fuzzy polynomial neurons (FPNs) and discuss its comprehensive design methodology. The underlying methodology involves mechanisms of genetic optimization, especially genetic algorithms (GAs). Let us recall that the design of the “conventional” FPNNs uses an extended Group Method of Data Handling (GMDH) and exploits a fixed fuzzy inference type located at each FPN of the FPNN as well as considers a fixed number of input nodes at FPNs (or nodes) located in each layer. The proposed FPNN gives rise to a structurally optimized structure and comes with a substantial level of flexibility in comparison to the one we encounter in conventional FPNNs. The structural optimization is realized via GAs whereas in the case of the parametric optimization we proceed with a standard least square method based learning. Through the consecutive process of such structural and parametric optimization, an optimized and flexible fuzzy neural network is generated in a dynamic fashion. The performance of the proposed gFPNN is quantified through experimentation that exploits standard data already being used in fuzzy modeling. The results reveal superiority of the proposed networks over the existing fuzzy and neural models.

MSC:

92B20 Neural networks for/in biological studies, artificial life and related topics
68T05 Learning and adaptive systems in artificial intelligence
90C59 Approximation methods and heuristics in mathematical programming

Software:

Genocop
Full Text: DOI

References:

[1] Cherkassky, V.; Gehring, D.; Mulier, F., IEEE Trans. Neural Networks, 7, 969 (1996)
[2] Dickerson, J. A.; Kosko, B., IEEE Trans. Systems Man Cybern., Part B, 26, 542 (1996)
[3] Sommer, V.; Tobias, P.; Kohl, D.; Sundgren, H.; Lundstrom, L., Sens. Actuators B, 28, 217 (1995)
[4] Kleinsteuber, S.; Sepehri, N., Comput. Elect. Eng., 22, 151 (1996)
[5] Cordon, O., Fuzzy Sets Systems, 141, 1, 5 (2004) · Zbl 1050.93513
[6] Oh, S.-K.; Pedrycz, W., Fuzzy Sets Systems, 142, 1, 163 (2004)
[7] Michalewicz, Z., Genetic Algorithms + Data Structures = Evolution Programs (1996), Springer-Verlag: Springer-Verlag Berlin · Zbl 0841.68047
[8] Jong, K. A.D., Are genetic algorithms function optimizers?, (Manner, R.; Manderick, B., Parallel Problem Solving from Nature, vol. 2 (1992), North-Holland: North-Holland Amsterdam)
[9] Oh, S.-K.; Pedrycz, W., Int. J. General Systems, 32, 3, 237 (2003) · Zbl 1036.93039
[10] Wang, L. X.; Mendel, J. M., IEEE Trans. Systems Man Cybern., 22, 6, 1414 (1992)
[11] Crowder, R. S., Predicting the Mackey-Glass time series with cascade-correlation learning, (Touretzky, D.; Hinton, G.; Sejnowski, T., Connectionist Models, Proceedings of the 1990 Summer School (1990), Morgan Kaufmann: Morgan Kaufmann San Mateo, CA), 117-123
[12] Jang, J. S.R., IEEE Trans. Systems Man Cybern., 23, 3, 665 (1993)
[13] Maguire, L. P.; Roche, B.; McGinnity, T. M.; McDaid, L. J., Inform. Sci., 112, 125 (1998) · Zbl 0953.68590
[14] James Li, C.; Huang, T.-Y., Appl. Math. Modeling, 23, 933 (1999) · Zbl 1062.70614
[15] Oh, S.-K.; Pedrycz, W.; Ahn, T.-C., Appl. Soft Computing, 2, 1F, 1 (2002)
[16] A.S. Lapedes, R. Farber, Non-linear signal processing using neural networks: prediction and system modeling, Technical Report LA-UR-87-2662, Los Alamos National Laboratory, Los Alamos, NM 87545, 1987; A.S. Lapedes, R. Farber, Non-linear signal processing using neural networks: prediction and system modeling, Technical Report LA-UR-87-2662, Los Alamos National Laboratory, Los Alamos, NM 87545, 1987
[17] Mackey, M. C.; Glass, L., Science, 197, 287 (1977) · Zbl 1383.92036
[18] Oh, S.-K.; Pedrycz, W., Information Sci., 141, 237 (2002) · Zbl 1008.68098
[19] Oh, S.-K.; Pedrycz, W.; Park, B.-J., Comput. Electr. Eng., 29, 6, 703 (2003)
[20] Tenorio, M. F.; Lee, W.-T., IEEE Trans. Neural Networks, 1, 1, 100 (1990)
[21] Kargupta, H.; Smith, R. E., System identification with evolving polynomial networks, (Proceedings of the 4th International Conference on Genetic Algorithms (1991)), 370-376
[22] Yao, X.; Liu, Y., IEEE Trans. Neural Networks, 8, 3, 694 (1997)
[23] Ksyonova, T. I.; Volkovich, V. V.; Tetko, I. V., Systems Anal. Modelling Simulation, 43, 10, 1331 (2003)
[24] Nikolaev, N.; Iba, H., Neural Networks, 16, 10, 1527 (2003)
[25] Nikolaev, N.; Iba, H., IEEE Trans. Neural Networks, 14, 2, 337 (2003)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.