Rough-fuzzy weighted \(k\)-nearest leader classifier for large data sets. (English) Zbl 1175.68353
Summary: A leaders set which is derived using the leaders clustering method can be used in place of a large training set to reduce the computational burden of a classifier. Recently, a fast and efficient leader-based classifier called weighted \(k\)-nearest leader-based classifier is shown by us to be an efficient and faster classifier. But, there exist some uncertainty while calculating the relative importance (weight) of the prototypes. This paper proposes a generalization over the earlier proposed \(k\)-nearest leader-based classifier where a novel soft computing approach is used to resolve the uncertainty. Combined principles of rough set theory and fuzzy set theory are used to analyze the proposed method. The proposed method called rough-fuzzy weighted \(k\)-nearest leader classifier (RF-\(wk\)-NLC) uses a two level hierarchy of prototypes along with their relative importance. RF-\(wk\)-NLC is shown by using some standard data sets to have improved performance and is compared with the earlier related methods.
MSC:
| 68T10 | Pattern recognition, speech recognition |
References:
| [1] | Duda, R. O.; Hart, P. E.; Stork, D. G., Pattern Classification (2000), Wiley-Interscience Publication, Wiley: Wiley-Interscience Publication, Wiley New York |
| [2] | Cover, T. M.; Hart, P. E., Nearest neighbor pattern classification, IEEE Transactions on Information Theory, 13, 1, 21-27 (1967) · Zbl 0154.44505 |
| [3] | Dasarathy, B. V., Nearest Neighbor (NN) Norms: NN Pattern Classification Techniques (1991), IEEE Computer Society Press: IEEE Computer Society Press Los Alamitos, CA |
| [4] | Hart, P. E., The condensed nearest-neighbor rule, IEEE Transactions on Information Theory, IT-4, 515-516 (1968) |
| [5] | Vijaya, P. A.; Murty, M. N.; Subramanian, D. K., Leaders-subleaders: an efficient hierarchical clustering algorithm for large data sets, Pattern Recognition Letters, 25, 505-513 (2004) |
| [6] | Spath, H., Cluster Analysis Algorithms for Data Reduction and Classification (1980), Ellis Horwood: Ellis Horwood Chichester, UK · Zbl 0435.62059 |
| [7] | Jain, A. K.; Dubes, R. C.; Chen, C. C., Bootstrap technique for error estimation, IEEE Transactions on Pattern Analysis and Machine Intelligence, 9, 628-633 (1987) · Zbl 0628.62043 |
| [8] | Asharaf, S.; Murthy, M. N., An adaptive rough fuzzy single pass algorithm for clustering large data sets, Pattern Recognition, 36, 12, 3015-3018 (2003) · Zbl 1058.68100 |
| [9] | V.S. Babu, P. Viswanath, Weighted \(k\)-nearest leader classifier for large data sets, in: Proceedings of the 2nd International Conference on Pattern Recognition and Machine Intelligence, Lecture Notes in Computer Science, Springer, Berlin, 2007, pp. 17-24.; V.S. Babu, P. Viswanath, Weighted \(k\)-nearest leader classifier for large data sets, in: Proceedings of the 2nd International Conference on Pattern Recognition and Machine Intelligence, Lecture Notes in Computer Science, Springer, Berlin, 2007, pp. 17-24. |
| [10] | Zadeh, L. A., Fuzzy sets, Information and control, 8, 338-353 (1965) · Zbl 0139.24606 |
| [11] | Pawlak, Z., Rough sets, International Journal of Computer and Information Sciences, 11, 341-356 (1982) · Zbl 0501.68053 |
| [12] | Dubois, D.; Prade, H., Rough fuzzy sets and fuzzy rough sets, International Journal of General Systems, 17, 2-3, 191-209 (1990) · Zbl 0715.04006 |
| [13] | Yao, Y. Y., A comparative study of fuzzy sets and rough sets, Information Sciences, 109, 1-4, 227-242 (1998) · Zbl 0932.03064 |
| [14] | Nanda, S.; Majumdar, S., Fuzzy rough sets, Fuzzy Sets and Systems, 45, 2, 157-160 (1992) · Zbl 0749.04004 |
| [15] | Chanas, S.; Kuchta, D., Further remarks on the relation between rough and fuzzy sets, Fuzzy Sets and Systems, 47, 391-394 (1992) · Zbl 0755.04008 |
| [16] | Sarkar, M., Fuzzy-rough nearest neighbor algorithms in classification, Fuzzy Sets and Systems, 158, 19, 2134-2152 (2007) · Zbl 1151.68616 |
| [17] | H. Bian, L. Mazlack, Fuzzy-rough nearest-neighbor classification approach, in: 22nd International Conference of the North American Fuzzy Information Processing Society, NAFIPS, 2003, pp. 500-505.; H. Bian, L. Mazlack, Fuzzy-rough nearest-neighbor classification approach, in: 22nd International Conference of the North American Fuzzy Information Processing Society, NAFIPS, 2003, pp. 500-505. |
| [18] | Keller, J. M.; Gray, M. R.; Givens, J. A., Fuzzy \(k\)-nearest neighbor algorithm, IEEE Transactions on Systems, Man and Cybernetics, 15, 4, 580-584 (1985) |
| [19] | Angiulli, F., Fast nearest neighbor condensation for large data sets classification, IEEE Transactions on Knowledge and Data Engineering, 19, 11, 1450-1464 (2007) |
| [20] | Aha, D. W.; Kibler, D.; Albert, M. K., Instance-based learning algorithms, Machine Learning, 6, 37-66 (1991) |
| [21] | Brighton, H.; Mellish, C., Advances in instance selection for instance-based learning algorithms, Data Mining and Knowledge Discovery, 6, 2, 153-172 (2002) · Zbl 1027.68673 |
| [22] | Wilson, D. R.; Martizen, T. R., Reduction techniques for instance-based learning algorithms, Machine Learning, 38, 257-286 (2000) · Zbl 0954.68126 |
| [23] | Aha, D. W., Editorial on lazy learning, Artificial Intelligence Review, 11, 7-10 (1997), (special issue) |
| [24] | Stanfill, C.; Waltz, D., Towards memory-based reasoning, Communications of the ACM, 29, 1213-1228 (1994) |
| [25] | I. Watson, F. Marir, Case-based reasoning: a review, Knowledge Engineering Review 9 (4).; I. Watson, F. Marir, Case-based reasoning: a review, Knowledge Engineering Review 9 (4). |
| [26] | Wilfong, G., Nearest neighbor problems, Computational Geometry and Applications, 2, 4, 383-416 (1992) · Zbl 0776.68102 |
| [27] | Alpaydin, E., Voting over multiple condensed nearest neighbors, Artificial Intelligence Review, 11, 115-132 (1997) |
| [28] | V. Susheela Devi, Optimal prototype selection for efficient pattern classifiers, Ph.D. Thesis, Department of Electrical Engineering, IISc, Bangalore, 2000.; V. Susheela Devi, Optimal prototype selection for efficient pattern classifiers, Ph.D. Thesis, Department of Electrical Engineering, IISc, Bangalore, 2000. |
| [29] | Gates, G. W., The reduced nearest neighbor rule, IEEE Transactions on Information Theory, 18, 3, 431-433 (1972) |
| [30] | Ritter, G. L.; Woodruff, H. B.; Lowry, S. R.; Isenhour, T. L., An algorithm for the selective nearest neighbor decision rule, IEEE Transactions on Information Theory, 21, 6, 665-669 (1975) · Zbl 0323.68023 |
| [31] | Barandela, R.; Ferri, F. J.; Sanchez, J. S., Decision boundary preserving prototype selection for nearest neighbor classification, International Journal of Pattern Recognition and Artificial Intelligence, 19, 6, 787-806 (2005) |
| [32] | Wilson, D. L., Asymptotic properties of nearest neighbor rules using edited data, IEEE Transactions on Systems, Man and Cybernetics, 2, 408-420 (1972) · Zbl 0276.62060 |
| [33] | Tomek, I., An experiment with the edited nearest-neighbor rule, IEEE Transactions on Systems, Man and Cybernetics, 6, 6, 448-452 (1976) · Zbl 0332.68081 |
| [34] | Chang, C. L., Finding prototypes for nearest neighbor classifiers, IEEE Transactions on Computers, 23, 11, 1179-1184 (1974) · Zbl 0292.68044 |
| [35] | Bezdek, J. C.; Reichherzer, T. R.; Lim, G. S.; Attikiouzel, Y., Multiple-prototype classifier design, IEEE Transactions on Systems, Man and Cybernetics, 28, 1, 67-79 (1998) |
| [36] | Mollineda, R. A.; Ferri, F. J.; Vidal, E., An efficient prototype merging strategy for the condensed 1-NN rule through class-conditional hierarchical clustering, Pattern Recognition, 35, 2771-2782 (2002) · Zbl 1007.68944 |
| [37] | Sanchez, J., High training set size reduction by space partitioning and prototype abstraction, Pattern Recognition, 37, 1561-1564 (2004) |
| [38] | Sanchez, J.; Marques, A., An LVQ-based adaptive algorithm for learning from very small codebooks, Neurocomputing, 69, 922-927 (2006) |
| [39] | Kohonen, T., Self-organizing Maps (1995), Springer: Springer Berlin, Heidelberg, Germany |
| [40] | Asharaf, S.; Murthy, M. N., A rough fuzzy approach to web usage categorization, Fuzzy Sets and Systems, 148, 1, 119-129 (2004) · Zbl 1071.68551 |
| [41] | Shen, Q.; Chouchoulas, A., A rough-fuzzy approach for generating classification rules, Pattern Recognition, 35, 11, 2425-2438 (2002) · Zbl 1006.68902 |
| [42] | Jensen, R.; Shen, Q., Fuzzy-rough attribute reduction with application to web categorization, Fuzzy Sets and Systems, 141, 3, 469-485 (2004) · Zbl 1069.68609 |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
