Abstract
Kernel clustering methods are useful to discover the non-linear structures hidden in data, but they suffer from the difficulty of kernel selection and high computational complexity. In this paper, we propose a novel random feature map-based multiple kernel fuzzy clustering method with all feature weights, in which low-rank randomized features of multiple kernels are generated by random Fourier feature map and Quasi-Monte Carlo feature map, and maximum entropy technique is applied to optimize the weights of all feature attributes. The proposed method is effective to extract important kernel and the important attributes of the kernel so as to achieve good clustering results. What is more, compared with conventional kernel clustering methods, our method is much more time-saving and is available to large data sets. The experiments based on various data sets show the superiority and efficiency of the proposed method.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Bezdek, J.C.: Pattern Recognition with Fuzzy Objective Function Algorithms. Springer Science & Business Media, Berlin (2013)
Bochner, S.: Monotone funktionen, stieltjessche integrale und harmonische analyse. Math. Ann. 108(1), 378–410 (1933)
Camastra, F., Verri, A.: A novel kernel method for clustering. IEEE Trans. Pattern Anal. Mach. Intell. 27(5), 801–805 (2005)
Chen, C.L.P., Zhang, T., Chen, L., Tam, S.C.: I-Ching divination evolutionary algorithm and its convergence analysis. IEEE Trans. Cybern. 47(1), 2–13 (2017). https://doi.org/10.1109/TCYB.2015.2512286
Chen, C.P., Lu, Y.: Fuzz: a fuzzy-based concept formation system that integrates human categorization and numerical clustering. IEEE Trans. Syst. Man Cybern. Part B Cybern. 27(1), 79–94 (1997)
Chen, L., Chen, C.P., Lu, M.: A multiple-kernel fuzzy c-means algorithm for image segmentation. IEEE Trans. Syst. Man Cybern. Part B Cybern. 41(5), 1263–1274 (2011)
Chiang, J.H., Hao, P.Y.: A new kernel-based fuzzy clustering approach: support vector clustering with cell growing. IEEE Trans. Fuzzy Syst. 11(4), 518–527 (2003)
Chitta, R., Jin, R., Jain, A.K.: Efficient kernel clustering using random Fourier features. In: 2012 IEEE 12th International Conference on Data Mining, pp. 161–170. IEEE, New York (2012)
Frank, A.: Uci machine learning repository. http://archive.ics.uci.edu/ml (2010). Accessed 27 Dec 2016
Girolami, M.: Mercer kernel-based clustering in feature space. IEEE Trans. Neural Netw. 13(3), 780–784 (2002)
Graves, D., Pedrycz, W.: Kernel-based fuzzy clustering and fuzzy clustering: a comparative experimental study. Fuzzy Sets Syst. 161(4), 522–543 (2010)
Han, J., Pei, J., Kamber, M.: Data mining: concepts and techniques. Elsevier, Amsterdam (2011)
Han, S.Y., Chen, Y.H., Tang, G.Y.: Fault diagnosis and fault-tolerant tracking control for discrete-time systems with faults and delays in actuator and measurement. J. Frankl. Inst. 354(12), 4719–4738 (2017)
Huang, H.C., Chuang, Y.Y., Chen, C.S.: Multiple kernel fuzzy clustering. IEEE Trans. Fuzzy Syst. 20(1), 120–134 (2012)
Kanungo, T., Mount, D.M., Netanyahu, N.S., Piatko, C.D., Silverman, R., Wu, A.Y.: An efficient k-means clustering algorithm: analysis and implementation. IEEE Trans. Pattern Anal. Mach. Intell. 7, 881–892 (2002)
Kim, D.W., Lee, K.Y., Lee, D., Lee, K.H.: Evaluation of the performance of clustering algorithms in kernel-induced feature space. Pattern Recognit. 38(4), 607–611 (2005)
Kong, L., Chen, L.: Approximate fuzzy kernel clustering with random feature mapping and dimension reduction. In: 2016 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD), pp. 960–965. IEEE, New York (2016)
Zill, D., Wright,W.S., Cullen, M.R.: Advanced engineering mathematics. Jones & Bartlett Learning (2011)
Krishna, K., Murty, N.M.: Genetic k-means algorithm. IEEE Tran. Syst. Man Cybern. Part B Cybern. 29(3), 433–439 (1999)
MacQueen, J., et al.: Some methods for classification and analysis of multivariate observations. In: Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, vol. 1, pp. 281–297. Oakland, CA, USA (1967)
Rahimi, A., Recht, B.: Random features for large-scale kernel machines. In: Advances in Neural Information Processing Systems, pp. 1177–1184 (2008)
Xu, R., Wunsch, D.: Survey of clustering algorithms. IEEE Trans. Neural Netw. 16(3), 645–678 (2005)
Yang, J., Sindhwani, V., Avron, H., Mahoney, M.: Quasi-Monte Carlo feature maps for shift-invariant kernels. J. Mach. Learn. Res. 17(1), 4096–4133 (2015)
Yu, J., Cheng, Q., Huang, H.: Analysis of the weighting exponent in the FCM. IEEE Trans. Syst. Man Cybern. Part B Cybern. 34(1), 634–639 (2004)
Yu, S., Tranchevent, L., Liu, X., Glanzel, W., Suykens, J.A., De Moor, B., Moreau, Y.: Optimized data fusion for kernel k-means clustering. IEEE Trans. Pattern Anal. Mach. Intell. 34(5), 1031–1039 (2012)
Zhang, T., Chen, C.L.P., Chen, L., Xu, X., Hu, B.: Design of highly nonlinear substitution boxes based on i-ching operators. IEEE Trans. Cybern. 48(12), 3349–3358 (2018). https://doi.org/10.1109/TCYB.2018.2846186
Zhang, T., Su, G., Qing, C., Xu, X., Cai, B., Xing, X.: Hierarchical lifelong learning by sharing representations and integrating hypothesis. IEEE Transactions on Systems, Man, and Cybernetics: Systems, pp. 1–11 (2019). https://doi.org/10.1109/TSMC.2018.2884996
Zhao, B., Kwok, J.T., Zhang, C.: Multiple kernel clustering. In: Proceedings of the 2009 SIAM International Conference on Data Mining, pp. 638–649. SIAM (2009)
Zhou, J., Chen, C.P., Chen, L.: Maximum-entropy-based multiple kernel fuzzy c-means clustering algorithm. In: 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp. 1198–1203. IEEE, New York (2014)
Zhou, J., Pan, Y., Wang, L., Chen, C.P.: Random feature based multiple kernel clustering. In: 2016 3rd International Conference on Informative and Cybernetics for Computational Social Systems (ICCSS), pp. 7–10. IEEE, New York (2016)
Zhu, L., Chung, F.L., Wang, S.: Generalized fuzzy c-means clustering algorithm with improved fuzzy partitions. IEEE Trans. Syst. Man Cybern. Part B Cybern. 39(3), 578–591 (2009)
Acknowledgements
This work was supported in part by the National Natural Science Foundation of China under Grants with Nos. 61873324 and 61573166, the Natural Science Foundation of Shandong Province under Grant with Nos. ZR2019MF040 and ZR2017MF044, the Shandong Province Key Research and Development Program under Grant with Nos. 2018GGX101048 and 2018GGX101016, and the Project of Shandong Province Higher Educational Science and Technology Program under Grant with No. J16LN07.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Wang, Y., Dong, J., Zhou, J. et al. Random Feature Map-Based Multiple Kernel Fuzzy Clustering with All Feature Weights. Int. J. Fuzzy Syst. 21, 2132–2146 (2019). https://doi.org/10.1007/s40815-019-00713-y
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40815-019-00713-y