On the inference and approximation properties of belief rule based systems. (English) Zbl 1284.68491
Summary: Belief rule based (BRB) system provides a generic inference framework for approximating complicated nonlinear causal relationships between antecedent inputs and output. It has been successfully applied to a wide range of areas, such as fault diagnosis, system identification and decision analysis. In this paper, we provide analytical and theoretical analyses on the inference and approximation properties of BRB systems. We first investigate the unified multi-model decomposition structure of BRB systems, under which the input space is partitioned into different local regions. Then we analyse the distributed approximation process of BRB systems. These analysis results unveil the underlying inference mechanisms that enable BRB systems to have superior approximation performances. Furthermore, by using the Stone-Weierstrass theorem, we constructively prove that BRB systems can approximate any continuous function on a compact set with arbitrary accuracy. This result provides a theoretical foundation for using and training BRB systems in practical applications. Finally, a numerical simulation study on the well-known benchmark nonlinear system identification problem of Box-Jenkins gas furnace is conducted to illustrate the validity of a BRB system and show its inference and approximation capability.
MSC:
| 68T05 | Learning and adaptive systems in artificial intelligence |
Keywords:
belief rule base; evidential reasoning; inference; universal approximation; system identificationReferences:
| [1] | Augusto, J. C.; Liu, J.; McCullagh, P. J.; Wang, H.; Yang, J. B., Management of uncertainty and spatio-temporal aspects for monitoring and diagnosis in a smart home, International Journal of Computational Intelligence Systems, 1, 4, 361-378 (2008) |
| [2] | Box, G. E.P.; Jenkins, G. M.; Reinse, G. C., Time Series Analysis: Forecasting and Control (1994), Prentice Hall: Prentice Hall NJ · Zbl 0858.62072 |
| [3] | Castro, J. L., Fuzzy logic controllers are universal approximators, IEEE Transactions on Systems, Man, and Cybernetics, 25, 4, 629-635 (1995) |
| [4] | Cheney, E. W., Introduction to Approximation Theory (1998), AMS Chelsea Publishing · Zbl 0912.41001 |
| [5] | Chen, Y. W.; Yang, J. B.; Xu, D. L.; Zhou, Z. J.; Tang, D. W., Inference analysis and adaptive training for belief rule based systems, Expert Systems with Applications, 36, 10, 12845-12860 (2011) |
| [6] | Dempster, A. P., A generalization of Bayesian inference, Journal of the Royal Statistical Society, Series B, 30, 2, 205-247 (1968) · Zbl 0169.21301 |
| [7] | Deng, X.; Wang, X., Incremental learning of dynamic fuzzy neural networks for accurate system modeling, Fuzzy Sets and Systems, 160, 972-987 (2009) · Zbl 1182.68164 |
| [8] | Denoeux, T., Conjunctive and disjunctive combination of belief functions induced by nondistinct bodies of evidence, Artificial Intelligence, 172, 234-264 (2008) · Zbl 1182.68298 |
| [9] | Giovanni, P.; Lurdes, I., Decision Theory: Principles and Approaches (2009), John Wiley & Sons · Zbl 1178.62004 |
| [10] | Gegov, A., Distributed Fuzzy Control of Multivariable Systems (1996), Kluwer Academic Publishers: Kluwer Academic Publishers The Netherlands, Dordrecht · Zbl 0855.93002 |
| [11] | Hornik, K.; Stinchcombe, M.; White, H., Multilayer feedforward networks are universal approximators, Neural Networks, 2, 5, 359-366 (1989) · Zbl 1383.92015 |
| [12] | Hayes-Roth, F., Rule-based systems, Communications of the ACM, 28, 9, 921-932 (1985) |
| [13] | Kecman, V., Learning and Soft Computing, Support Vector Machines, Neural Networks, and Fuzzy Logic Models (2001), MIT Press: MIT Press Cambridge, MA · Zbl 0994.68109 |
| [14] | Kim, J.; Kasabov, N., HyFIS: adaptive neuro-fuzzy inference systems and their application to nonlinear dynamical systems, Neural Networks, 12, 1301-1319 (1999) |
| [15] | Kukolj, D.; Levi, E., Identification of complex systems based on neural and Takagi-Sugeno fuzzy model, IEEE Transactions on Systems, Man, and Cybernetics - Part B: Cybernetics, 34, 1, 272-282 (2004) |
| [16] | Lawry, J., A framework for linguistic modelling, Artificial Intelligence, 155, 1-39 (2004) · Zbl 1085.68695 |
| [17] | Ligęza, A., Logical Foundations for Rule-Based Systems (2006), Springer-Verlag: Springer-Verlag Berlin, Heidelberg · Zbl 1095.68113 |
| [18] | Liu, J.; Yang, J. B.; Ruan, D.; Martinez, L.; Wang, J., Self-tuning of fuzzy belief rule bases for engineering system safety analysis, Annals of Operations Research, 163, 1, 143-168 (2008) · Zbl 1171.90570 |
| [19] | Rezaee, B.; Fazel Zarandi, M. H., Data-driven fuzzy modeling for Takagi-Sugeno-Kang fuzzy system, Information Sciences, 180, 241-255 (2010) |
| [20] | Shafer, G., Mathematical Theory of Evidence (1976), Princeton University Press: Princeton University Press Princeton, NJ · Zbl 0359.62002 |
| [21] | Stone, M. H., The generalized Weierstrass approximation theorem, Mathematics Magazine, 21, 167-183 (1948) |
| [22] | Sun, R., Robust reasoning: integrating rule-based and similarity-based reasoning, Artificial Intelligence, 75, 241-295 (1995) |
| [23] | Tikk, D.; Kóczy, L. T.; Gedeon, T. D., A survey on universal approximation and its limits in soft computing techniques, International Journal of Approximate Reasoning, 33, 185-202 (2003) · Zbl 1045.68113 |
| [24] | Wang, L. X.; Mendel, J. M., Fuzzy basis functions, universal approximation, and orthogonal least-squares learning, IEEE Transactions on Neural Networks, 3, 5, 807-814 (1992) |
| [25] | Wang, Y. M.; Yang, J. B.; Xu, D. L., Environmental impact assessment using the evidential reasoning approach, European Journal of Operational Research, 174, 3, 1885-1913 (2006) · Zbl 1103.90364 |
| [26] | Xu, D. L.; Yang, J. B.; Wang, Y. M., The ER approach for multi-attribute decision analysis under interval uncertainties, European Journal of Operational Research, 174, 3, 1914-1943 (2006) · Zbl 1103.90365 |
| [27] | Xu, D. L.; Liu, J.; Yang, J. B.; Liu, G. P.; Wang, J.; Jenkinson, I.; Ren, J., Inference and learning methodology of belief-rule-based expert system for pipeline leak detection, Expert Systems with Applications, 32, 1, 103-113 (2007) |
| [28] | Yang, J. B.; Singh, M. G., An evidential reasoning approach for multiple attribute decision making with uncertainty, IEEE Transactions on Systems, Man, and Cybernetics, 24, 1, 1-18 (1994) |
| [29] | Yang, J. B., Rule and utility based evidential reasoning approach for multiple attribute decision analysis under uncertainty, European Journal of Operational Research, 131, 1, 31-61 (2001) · Zbl 0979.90081 |
| [30] | Yang, J. B.; Xu, D. L., On the evidential reasoning algorithm for multiattribute decision analysis under uncertainty, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans, 32, 3, 289-304 (2002) |
| [31] | Yang, J. B.; Liu, J.; Wang, J.; Sii, H. S.; Wang, H. W., A belief rule-base inference methodology using the evidential reasoning approach - RIMER, IEEE Transactions on Systems, Man, and Cybernetics - Part A, 36, 2, 266-285 (2006) |
| [32] | Yang, J. B.; Liu, J.; Xu, D. L.; Wang, J.; Wang, H. W., Optimization models for training belief rule based systems, IEEE Transactions on Systems, Man, and Cybernetics - Part A, 37, 4, 569-585 (2007) |
| [33] | Yoon, K.; Hwang, C. L., Multiple Attribute Decision Making: An Introduction (1995), Sage Publications: Sage Publications Thousand Oaks, CA |
| [34] | Zeng, X. J.; Singh, M. G., Approximation accuracy analysis of fuzzy systems as function approximators, IEEE Transactions on Fuzzy Systems, 4, 1, 44-53 (1996) |
| [35] | Zhou, Z. J.; Hu, C. H.; Yang, J. B.; Xu, D. L.; Zhou, D. H., Online updating belief-rule-based system for pipeline leak detection under expert intervention, Expert Systems with Applications, 36, 7700-7709 (2009) |
| [36] | Zhou, Z. J.; Hu, C. H.; Xu, D. L.; Yang, J. B.; Zhou, D. H., New model for system behaviour prediction based on belief-rule-based systems, Information Sciences, 180, 4834-4864 (2010) |
| [37] | Zorich, V. A., Mathematical Analysis (2004), Springer-Verlag: Springer-Verlag Berlin, Heidelberg · Zbl 1071.00003 |
| [38] | Yang, J. B.; Wang, Y. M.; Xu, D. L.; Chin, K. S.; Chatton, L., Belief rule-based methodology for mapping consumer preferences and setting product targets, Expert Systems with Applications, 39, 4749-4759 (2012) |
| [39] | Mendel, J. M., Type-2 fuzzy sets and systems: an overview, IEEE Computational Intelligence Magazine, 20-29 (2007) |
| [40] | Sanz, J. A.; Fernandez, A.; Bustince, H.; Herrera, F., Improving the performance of fuzzy rule-based classification systems with interval-valued fuzzy sets and genetic amplitude tuning, Information Sciences, 180, 19, 3674-3685 (2010) |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
