×

One-step incomplete multiview clustering with low-rank tensor graph learning. (English) Zbl 07830653

Summary: Incomplete multiview clustering (IMVC) has attracted extensive attention in the field of machine learning due to its excellent performance in handling incomplete multiview data (IMVD). However, existing IMVC methods often use spectral clustering or k-means on the obtained affinity matrices to obtain the final clustering results, that is, the affinity matrices learning process and clustering process are separated. In this paper, we propose a new ingenious IMVC method, one-step incomplete multiview clustering with low-rank tensor graph learning (OIMVC/LTGL), to solve the problem. This method combines graph learning, low-rank tensor constraint, common representation learning and clustering into a unified optimization framework. First, we utilize the adjacency relationship between views to complete the similarity graph matrices. Second, we stack all similarity graph matrices into a third-order tensor. To mine higher-order correlations among different views, we impose a low-rank tensor constraint, the tensor nuclear norm (TNN), into the constructed tensor. Third, to explore consistent information between views, we introduce a common representation learning term to learn the optimal consensus representation. Last, we introduce spectral rotation to the consensus representation matrices to directly obtain the clustering labels. These steps promote each other for better clustering performance. We solve the optimization problem by using the augmented Lagrange multiplier (ALM) method. Experiments based on five well-known datasets show the superiority of our method.

MSC:

68T05 Learning and adaptive systems in artificial intelligence
62H30 Classification and discrimination; cluster analysis (statistical aspects)
Full Text: DOI

References:

[1] Akimushkin, C.; Amancio, D. R.; Oliveira, O. N., On the role of words in the network structure of texts: application to authorship attribution, Physica A: Stat. Mech. Appl., 495, 49-58 (2018)
[2] Chao, G.; Sun, S.; Bi, J., A survey on multiview clustering, IEEE Trans. Artif. Intell., 2, 146-168 (2021)
[3] K. Hammouda, F. Karray, A comparative study of data clustering techniques, University of Waterloo, Ontario, Canada, 1 (2000).
[4] M. Hu, S. Chen, Doubly Aligned Incomplete Multi-view Clustering, in: Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence 2018, pp. 2262-2268.
[5] Hu, W.; Tao, D.; Zhang, W.; Xie, Y.; Yang, Y., The twist tensor nuclear norm for video completion, IEEE Trans. Neural Networks Learn. Syst., 28, 12, 2961-2973 (2016)
[6] Kilmer, M. E.; Martin, C. D., Factorization strategies for third-order tensors, Linear Algebra Appl., 435, 3, 641-658 (2011) · Zbl 1228.15009
[7] Li, F.-F.; Rob, F.; Pietro, P., Learning generative visual models from few training examples: An incremental bayesian approach tested on 101 object categories, (In: 2004 Conference on Computer Vision and Pattern Recognition Workshop (2004)), 178
[8] Li, S.-Y.; Jiang, Y.; Zhou, Z.-H., Partial multi-view clustering, in, (Proceedings of the AAAI Conference on Artificial Intelligence (2014)), 1968-1974
[9] Liang, Y.; Huang, D.; Wang, C., Consistency Meets Inconsistency: A Unified Graph Learning Framework for Multi-view Clustering, (2019 IEEE International Conference on Data Mining (ICDM) (2019)), 1204-1209
[10] V.Q. Marinho, G. Hirst, D.R. Amancio, Authorship attribution via network motifs identification, in: 2016 5th Brazilian conference on intelligent systems (BRACIS), IEEE, 2016, pp. 355-360.
[11] Pang, Y.; Xie, J.; Nie, F.; Li, X., Spectral clustering by joint spectral embedding and spectral rotation, IEEE Trans. Cybern., 50, 1, 247-258 (2018)
[12] Rai, N.; Negi, S.; Chaudhury, S.; Deshmukh, O., Partial multi-view clustering using graph regularized NMF, (In: 2016 23rd International Conference on Pattern Recognition (ICPR) (2016)), 2192-2197
[13] P. Rai, A. Trivedi, H. Daumé III, S.L. DuVall, Multiview clustering with incomplete views, in: Proceedings of the NIPS Workshop on Machine Learning for Social Computing, Citeseer, 2010.
[14] L.B.d. Santos, E.A. Corrêa Jr, O.N. Oliveira Jr, D.R. Amancio, L.L. Mansur, S.M. Aluísio, Enriching complex networks with word embeddings for detecting mild cognitive impairment from speech transcripts, in: Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, 2017, pp. 1284-1296.
[15] Semerci, O.; Hao, N.; Kilmer, M. E.; Miller, E. L., Tensor-based formulation and nuclear norm regularization for multienergy computed tomography, IEEE Trans. Image Process., 23, 4, 1678-1693 (2014) · Zbl 1374.94335
[16] Shao, W.; He, L.; Lu, C.-T.; Philip, S. Y., Online multi-view clustering with incomplete views, IEEE Int. Conf. on Big Data (Big Data), 2016, 1012-1017 (2016)
[17] W. Shao, L. He, S.Y. Philip, Multiple incomplete views clustering via weighted nonnegative matrix factorization with L_2,1 regularization, in: Joint European Conference on Machine Learning and Knowledge Discovery in Databases, 2015, pp. 318-334.
[18] Wang, H.; Yang, Y.; Liu, B.; Fujita, H., A study of graph-based system for multi-view clustering, Knowl.-Based Syst., 163, 1009-1019 (2019)
[19] H. Wang, L. Zong, B. Liu, Y. Yang, W. Zhou, Spectral Perturbation Meets Incomplete Multi-view Data, in: Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence 2019, pp. 3677-3683.
[20] Wang, S.; Liu, X.; Liu, L.; Tu, W.; Zhu, X.; Liu, J.; Zhou, S.; Zhu, E., Highly-efficient incomplete large-scale multi-view clustering with consensus bipartite graph, (In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (2022)), 9776-9785
[21] Wang, Y.; Lin, X.; Wu, L.; Zhang, W.; Zhang, Q.; Huang, X., Robust subspace clustering for multi-view data by exploiting correlation consensus, IEEE Trans. Image Process., 24, 11, 3939-3949 (2015) · Zbl 1408.94694
[22] Wen, J.; Sun, H.; Fei, L.; Li, J.; Zhang, Z.; Zhang, B., Consensus guided incomplete multi-view spectral clustering, Neural Networks, 133, 207-219 (2021) · Zbl 1475.62198
[23] Wen, J.; Yan, K.; Zhang, Z.; Xu, Y., Low-rank tensor graph learning based incomplete multi-view clustering, Acta Automatica Sinica, 47, 1-13 (2021)
[24] Wen, J.; Yan, K.; Zhang, Z.; Xu, Y.; Wang, J.; Fei, L.; Zhang, B., Adaptive graph completion based incomplete multi-view clustering, IEEE Trans. Multimedia, 23, 2493-2504 (2021)
[25] Wen, J.; Zhang, Z.; Xu, Y.; Zhang, B.; Fei, L.; Liu, H., Unified embedding alignment with missing views inferring for incomplete multi-view clustering, (In: Proceedings of the AAAI Conference on Artificial Intelligence (2019)), 5393-5400
[26] Wen, J.; Zhang, Z.; Zhang, Z.; Zhu, L.; Fei, L.; Zhang, B.; Xu, Y., (Unified Tensor Framework for Incomplete Multi-view Clustering and Missing-view Inferring, In: Proc (2021), AAAI Press: AAAI Press Online), 10273-10281
[27] Wu, J.; Lin, Z.; Zha, H., Essential tensor learning for multi-view spectral clustering, IEEE Trans. Image Process., 28, 12, 5910-5922 (2019) · Zbl 1532.68087
[28] Yu, X.; Liu, H.; Lin, Y.; Wu, Y.; Zhang, C., Auto-weighted sample-level fusion with anchors for incomplete multi-view clustering, Pattern Recogn. (2022)
[29] Zhang, C.; Fu, H.; Hu, Q.; Cao, X.; Xie, Y.; Tao, D.; Xu, D., Generalized latent multi-view subspace clustering, IEEE Trans. Pattern Anal. Mach. Intell., 42, 1, 86-99 (2018)
[30] Zhang, C.; Fu, H.; Liu, S.; Liu, G.; Cao, X., Low-Rank Tensor Constrained Multiview Subspace Clustering, (2015 IEEE International Conference on Computer Vision (ICCV) (2015)), 1582-1590
[31] Zhang, C.; Hu, Q.; Fu, H.; Zhu, P.; Cao, X., Latent multi-view subspace clustering, in, (Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2017)), 4279-4287
[32] Zhang, P.; Liu, X.; Xiong, J.; Zhou, S.; Zhao, W.; Zhu, E.; Cai, Z., Consensus one-step multi-view subspace clustering, IEEE Trans. Knowl. Data Eng. (2020)
[33] Zhao, B.-Y.; Zhang, C.-Q.; Chen, L.; Liu, X.-W.; Li, Z.-C.; Hu, Q.-H., Generative model for partial multi-view clustering, Acta Automatica Sinica, 45, 8, 1867-1875 (2021) · Zbl 1488.68121
[34] Zhao, H.; Liu, H.; Fu, Y., Incomplete multi-modal visual data grouping, in, (Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence (2016)), 2392-2398
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.