×

Self-paced multi-view positive and unlabeled graph learning with auxiliary information. (English) Zbl 1541.68320

Summary: Graph widely exists in the research study, with complex structure and rich information, and it has always been a powerful mode to analyze difficult problems. Meanwhile, graph classification is an important application problem in many fields, it means that we use the structure of known graph datasets to classify the unknown graph. Most of the current work is to classify through positive and unlabeled learning (PU learning) and multi-view learning respectively. For training and testing data, it is believed that they all have the same feature representation, but in fact, we can gain auxiliary features called privileged information for the training data. In the past, privileged information is always ignored in PU graph learning. To enhance the efficiency of the classifier, a new method called SMPUP is presented, which first extracts the features of graph from different perspectives, and introduces privileged information into the PU learning method to construct the classifier model. Further, we have introduced a self-paced learning (SPL) framework to ensure the model can learn efficiently. A large number of experiments with graph and biological datasets show that the SMPUP method performs better than previous methods.

MSC:

68T05 Learning and adaptive systems in artificial intelligence

Software:

graph2vec; node2vec
Full Text: DOI

References:

[1] Bengio, Yoshua; Louradour, Jérôme; Collobert, Ronan; Weston, Jason, Curriculum learning, (Proceedings of the 26th Annual International Conference on Machine Learning. Proceedings of the 26th Annual International Conference on Machine Learning, ICML ’09 (2009), Association for Computing Machinery: Association for Computing Machinery New York, NY, USA), 41-48
[2] Carnevali, Julio César; Rossi, Rafael Geraldeli; Milios, Evangelos E.; Lopes, Alneu de Andrade, A graph-based approach for positive and unlabeled learning, Inf. Sci., 580, 655-672 (2021) · Zbl 1535.68253
[3] Chen, Jinyin; Xiong, Haiyang; Zheng, Haibin; Zhang, Dunjie; Zhang, Jian; Jia, Mingwei; Liu, Yi, EGC^2: enhanced graph classification with easy graph compression, Inf. Sci., 629, 376-397 (2023)
[4] Chen, Rui; Tang, Yongqiang; Tian, Lei; Zhang, Caixia; Zhang, Wensheng, Deep convolutional self-paced clustering, Appl. Intell., 52, 5, 4858-4872 (2022)
[5] Derrac, Joaquín; García, Salvador; Molina, Daniel; Herrera, Francisco, A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms, Swarm Evol. Comput., 1, 1, 3-18 (2011)
[6] Elkan, Charles; Noto, Keith, Learning classifiers from only positive and unlabeled data, (Li, Ying; Liu, Bing; Sarawagi, Sunita, Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Las Vegas, Nevada, USA, August 24-27, 2008 (2008), ACM), 213-220
[7] Grover, Aditya; Leskovec, Jure, node2vec: scalable feature learning for networks, (Krishnapuram, Balaji; Shah, Mohak; Smola, Alexander J.; Aggarwal, Charu C.; Shen, Dou; Rastogi, Rajeev, Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA, August 13-17, 2016 (2016), ACM), 855-864
[8] Han, Kun; Chen, Weitong; Xu, Miao, Investigating active positive-unlabeled learning with deep networks, (Long, Guodong; Yu, Xinghuo; Wang, Sen, AI 2021: Advances in Artificial Intelligence - Proceedings of the 34th Australasian Joint Conference. AI 2021: Advances in Artificial Intelligence - Proceedings of the 34th Australasian Joint Conference, AI 2021, Sydney, NSW, Australia, February 2-4, 2022. AI 2021: Advances in Artificial Intelligence - Proceedings of the 34th Australasian Joint Conference. AI 2021: Advances in Artificial Intelligence - Proceedings of the 34th Australasian Joint Conference, AI 2021, Sydney, NSW, Australia, February 2-4, 2022, Lecture Notes in Computer Science, vol. 13151 (2022), Springer), 607-618
[9] He, Fengxiang; Liu, Tongliang; Webb, Geoffrey I.; Tao, Dacheng, Instance-dependent PU learning by Bayesian optimal relabeling (2018), CoRR
[10] Hosseinzadeh, Hamidreza, Deep multi-view feature learning for detecting COVID-19 based on chest x-ray images, Biomed. Signal Process. Control, 75, Article 103595 pp. (2022)
[11] Huang, Zongmo; Ren, Yazhou; Pu, Xiaorong; He, Lifang, Non-linear fusion for self-paced multi-view clustering, (Shen, Heng Tao; Zhuang, Yueting; Smith, John R.; Yang, Yang; Cesar, Pablo; Metze, Florian; Prabhakaran, Balakrishnan, MM ’21: ACM Multimedia Conference, Virtual Event. MM ’21: ACM Multimedia Conference, Virtual Event, China, October 20-24, 2021 (2021), ACM), 3211-3219
[12] Hussain, Syed Fawad; Khan, Khadija; Jillani, Rashad M., Weighted multi-view co-clustering (WMVCC) for sparse data, Appl. Intell., 52, 1, 398-416 (2022)
[13] Jiang, Bingbing; Xiang, Junhao; Wu, Xingyu; Wang, Yadi; Chen, Huanhuan; Cao, Weiwei; Sheng, Weiguo, Robust multi-view learning via adaptive regression, Inf. Sci., 610, 916-937 (2022) · Zbl 07825484
[14] Jiang, Lu; Meng, Deyu; Zhao, Qian; Shan, Shiguang; Hauptmann, Alexander G., Self-paced curriculum learning, (Bonet, Blai; Koenig, Sven, Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence. Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, Austin, Texas, USA, January 25-30, 2015 (2015), AAAI Press), 2694-2700
[15] Jiang, Yufeng; Haihong, E.; Song, Meina; Zhang, Ken, Research and application of newborn defects prediction based on spark and PU-learning, (5th IEEE International Conference on Cloud Computing and Intelligence Systems. 5th IEEE International Conference on Cloud Computing and Intelligence Systems, CCIS 2018, Nanjing, China, November 23-25, 2018 (2018), IEEE), 657-663
[16] Ke, Ting; Jing, Ling; Lv, Hui; Zhang, Lidong; Hu, Yaping, Global and local learning from positive and unlabeled examples, Appl. Intell., 48, 8, 2373-2392 (2018)
[17] Kumar, M.; Packer, Benjamin; Koller, Daphne, Self-paced learning for latent variable models, (Lafferty, J.; Williams, C.; Shawe-Taylor, J.; Zemel, R.; Culotta, A., Advances in Neural Information Processing Systems, vol. 23 (2010), Curran Associates, Inc.)
[18] Lei, Jing; Liu, Qibin, Self-paced learning-assisted regularization reconstruction method with data-adaptive prior for electrical capacitance tomography, Expert Syst. Appl., 191, Article 116296 pp. (2022)
[19] Li, Hui; Deng, Zhaohong; Yang, Haitao; Pan, Xiaoyong; Wei, Zhisheng; Shen, Hong-Bin; Choi, Kup-Sze; Wang, Lei; Wang, Shitong; Wu, Jing, circRNA-binding protein site prediction based on multi-view deep learning, subspace learning and multi-view classifier, Brief. Bioinform., 23, 1 (2022)
[20] Li, Weiyi; Chen, Hongmei; Li, Tianrui; Wan, Jihong; Sang, Binbin, Unsupervised feature selection via self-paced learning and low-redundant regularization, Knowl.-Based Syst., 240, Article 108150 pp. (2022)
[21] Li, Zhongguo; Oskarsson, Magnus; Heyden, Anders, Detailed 3d human body reconstruction from multi-view images combining voxel super-resolution and learned implicit representation, Appl. Intell., 52, 6, 6739-6759 (2022)
[22] Lin, Qiang; Men, Min; Yang, Liran; Zhong, Ping, A supervised multi-view feature selection method based on locally sparse regularization and block computing, Inf. Sci., 582, 146-166 (2022)
[23] Liu, Bo; Liu, Laiwang; Xiao, Yanshan; Liu, Changdong; Chen, Xiaodong; Li, Weibin, Adaboost-based transfer learning with privileged information, Inf. Sci., 593, 216-232 (2022) · Zbl 1535.68269
[24] Lyu, Ziyu; Yang, Min; Li, Hui, Multi-view group representation learning for location-aware group recommendation, Inf. Sci., 580, 495-509 (2021)
[25] Mordelet, Fantine; Vert, Jean-Philippe, A bagging SVM to learn from positive and unlabeled examples, Pattern Recognit. Lett., 37, 201-209 (2014)
[26] Narayanan, Annamalai; Chandramohan, Mahinthan; Venkatesan, Rajasekar; Chen, Lihui; Liu, Yang; Jaiswal, Shantanu, graph2vec: learning distributed representations of graphs (2017), CoRR
[27] Natarajan, Nagarajan; Dhillon, Inderjit S.; Ravikumar, Pradeep; Tewari, Ambuj, Learning with noisy labels, (Burges, Christopher J. C.; Bottou, Léon; Ghahramani, Zoubin; Weinberger, Kilian Q., Advances in Neural Information Processing Systems 26: 27th Annual Conference on Neural Information Processing Systems 2013. Advances in Neural Information Processing Systems 26: 27th Annual Conference on Neural Information Processing Systems 2013, Lake Tahoe, Nevada, United States, December 5-8, 2013 (2013)), 1196-1204 · Zbl 1467.68151
[28] Nguyen, Dang; Luo, Wei; Nguyen, Tu Dinh; Venkatesh, Svetha; Phung, Dinh Q., Learning graph representation via frequent subgraphs, (Ester, Martin; Pedreschi, Dino, Proceedings of the 2018 SIAM International Conference on Data Mining. Proceedings of the 2018 SIAM International Conference on Data Mining, SDM 2018, May 3-5, 2018, San Diego Marriott Mission Valley, San Diego, CA, USA (2018), SIAM), 306-314
[29] Nigam, Kamal; McCallum, Andrew; Thrun, Sebastian; Mitchell, Tom M., Text classification from labeled and unlabeled documents using EM, Mach. Learn., 39, 2/3, 103-134 (2000) · Zbl 0949.68162
[30] Shivagunde, Saroj S.; Saradhi, V. Vijaya, 2d multi-view discriminant analysis, Inf. Sci., 586, 391-407 (2022)
[31] Song, Wenjing; Wang, Weiwen; Dai, Dao-Qing, Subtype-WESLR: identifying cancer subtype with weighted ensemble sparse latent representation of multi-view data, Brief. Bioinform., 23, 1 (2022)
[32] Wang, Ge; Xue, Min-Qi; Shen, Hong-Bin; Xu, Ying-Ying, Learning protein subcellular localization multi-view patterns from heterogeneous data of imaging, sequence and networks, Brief. Bioinform., 23, 2 (2022)
[33] Wang, Qingyong; Zhou, Yun, FedSPL: federated self-paced learning for privacy-preserving disease diagnosis, Brief. Bioinform., 23, 1, Article bbab498 pp. (12 2021)
[34] Wang, Qingyong; Zhou, Yun; Cao, Zehong; Zhang, Weiming, M2spl: generative multiview features with adaptive meta-self-paced sampling for class-imbalance learning, Expert Syst. Appl., 189, Article 115999 pp. (2022)
[35] Wang, Shiping; Xiao, Shunxin; Zhu, William; Guo, Yingya, Multi-view fuzzy clustering of deep random walk and sparse low-rank embedding, Inf. Sci., 586, 224-238 (2022) · Zbl 07805364
[36] Wen, Guangqi; Cao, Peng; Bao, Huiwen; Yang, Wenju; Zheng, Tong; Zaïane, Osmar, MVS-GCN: a prior brain structure learning-guided multi-view graph convolution network for autism spectrum disorder diagnosis, Comput. Biol. Med., 142, Article 105239 pp. (2022)
[37] Won, Ji Hye; Youn, Jinyoung; Park, Hyunjin, Enhanced neuroimaging genetics using multi-view non-negative matrix factorization with sparsity and prior knowledge, Med. Image Anal., 77, Article 102378 pp. (2022)
[38] Wu, Fei; Jing, Xiao-Yuan; Wei, Pengfei; Lan, Chao; Ji, Yimu; Jiang, Guo-Ping; Huang, Qinghua, Semi-supervised multi-view graph convolutional networks with application to webpage classification, Inf. Sci., 591, 142-154 (2022)
[39] Wu, Peishu; Wang, Zidong; Zheng, Baixun; Li, Han; Alsaadi, Fuad E.; Zeng, Nianyin, AGGN: attention-based glioma grading network with multi-scale feature extraction and multi-modal information fusion, Comput. Biol. Med., 152, Article 106457 pp. (2023)
[40] Wu, Zhengning; Xia, Xiaobo; Wang, Ruxin; Li, Jiatong; Yu, Jun; Mao, Yinian; Liu, Tongliang, LR-SVM+: learning using privileged information with noisy labels, IEEE Trans. Multimed., 24, 1080-1092 (2022)
[41] Xu, Ruxin; Wang, Huiru, Multi-view learning with privileged weighted twin support vector machine, Expert Syst. Appl., 206, Article 117787 pp. (2022)
[42] Xu, Wei; Liu, Wei; Chi, Haoyuan; Qiu, Song; Jin, Yu, Self-paced learning with privileged information, Neurocomputing, 362, 147-155 (2019)
[43] Yang, Xiang-Fei; Li, Chun-Na; Shao, Yuan-Hai, Robust multi-view discriminant analysis with view-consistency, Inf. Sci., 596, 153-168 (2022) · Zbl 07810765
[44] Yoo, Jaemin; Kim, Junghun; Yoon, Hoyoung; Kim, Geonsoo; Jang, Changwon; Kang, U., Graph-based PU learning for binary and multiclass classification without class prior, Knowl. Inf. Syst., 64, 8, 2141-2169 (2022)
[45] Zeng, Nianyin; Wu, Peishu; Wang, Zidong; Li, Han; Liu, Weibo; Liu, Xiaohui, A small-sized object detection oriented multi-scale feature fusion approach with application to defect detection, IEEE Trans. Instrum. Meas., 71, 1-14 (2022)
[46] Zhao, Meng; Yang, Jing; Zhang, Jianpei; Wang, Shenglong, Aggregated graph convolutional networks for aspect-based sentiment classification, Inf. Sci., 600, 73-93 (2022)
[47] Zhou, Joey Tianyi; Pan, Sinno Jialin; Mao, Qi; Tsang, Ivor W., Multi-view positive and unlabeled learning, (Hoi, Steven C. H.; Buntine, Wray L., Proceedings of the 4th Asian Conference on Machine Learning. Proceedings of the 4th Asian Conference on Machine Learning, ACML 2012, Singapore, Singapore, November 4-6, 2012. Proceedings of the 4th Asian Conference on Machine Learning. Proceedings of the 4th Asian Conference on Machine Learning, ACML 2012, Singapore, Singapore, November 4-6, 2012, JMLR Proceedings, vol. 25 (2012)), 555-570
[48] Zhu, Hu; Wang, Xueqin; Xu, Guoxia; Deng, Lizhen, A self-paced learning based transfer model for hypergraph matching, Inf. Sci., 590, 253-266 (2022)
[49] Zhu, Zonghai; Xing, Huanlai; Xu, Yuge, Balanced neighbor exploration for semi-supervised node classification on imbalanced graph data, Inf. Sci., 631, 31-44 (2023)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.