×

Multi-source adaptation joint kernel sparse representation for visual classification. (English) Zbl 1414.68079

Summary: Most of the existing domain adaptation learning (DAL) methods relies on a single source domain to learn a classifier with well-generalized performance for the target domain of interest, which may lead to the so-called negative transfer problem. To this end, many multi-source adaptation methods have been proposed. While the advantages of using multi-source domains of information for establishing an adaptation model have been widely recognized, how to boost the robustness of the computational model for multi-source adaptation learning has only recently received attention. To address this issue for achieving enhanced performance, we propose in this paper a novel algorithm called multi-source Adaptation Regularization Joint Kernel Sparse Representation (ARJKSR) for robust visual classification problems. Specifically, ARJKSR jointly represents target dataset by a sparse linear combination of training data of each source domain in some optimal Reproduced Kernel Hilbert Space (RKHS), recovered by simultaneously minimizing the inter-domain distribution discrepancy and maximizing the local consistency, whilst constraining the observations from both target and source domains to share their sparse representations. The optimization problem of ARJKSR can be solved using an efficient alternative direction method. Under the framework ARJKSR, we further learn a robust label prediction matrix for the unlabeled instances of target domain based on the classical graph-based semi-supervised learning (GSSL) diagram, into which multiple Laplacian graphs constructed with the ARJKSR are incorporated. The validity of our method is examined by several visual classification problems. Results demonstrate the superiority of our method in comparison to several state-of-the-arts.

MSC:

68T05 Learning and adaptive systems in artificial intelligence
62H30 Classification and discrimination; cluster analysis (statistical aspects)

Software:

SHOGUN
Full Text: DOI

References:

[1] Afonso, M.; Bioucas-Dias, J.; Figueiredo, M., An augmented lagrangian approach to the constrained optimization formulation of imaging inverse problems, IEEE Transactions on Image Processing, 20, 3, 681-695 (2011) · Zbl 1372.94004
[2] Bruzzone, L.; Marconcini, M., Domain adaptation problems: A DASVM classification technique and a circular validation strategy, IEEE Transactions on Pattern Analysis and Machine Intelligence, 32, 5, 770-787 (2010)
[3] Cai, Deng; He, Xiaofei; Han, Jiawei, Orthogonal Laplacianfaces for Face Recognition, IEEE Transactions on Image Processing, 15, 11, 3608-3614 (2006)
[6] Cheng, B.; Yang, J.; Yan, S.; Fu, Y.; Huang, T., Learning with l1-graph for image analysis, IEEE Transactions on Image Processing, 19, 4 (2010) · Zbl 1371.68229
[9] Duan, L.; Tsang, I. W.; Xu, D., Domain transfer multiple kernel learning, IEEE Transactions on Pattern Analysis and Machine Intelligence, 465-479 (2012)
[12] Duan, Lixin; Xu, D.; Tsang, I. W., Domain adaptation from multiple sources: A domain-dependent regularization approach, IEEE Transactions on Neural Networks and Learning Systems, 504-518 (2012)
[14] Fan, M.; Gu, N.; Qiao, H.; Zhang, B., Sparse regularization for semi-supervised classification, Pattern Recognition, 44, 8, 1777-1784 (2011) · Zbl 1218.68120
[15] Gao, Shenghua; Tsang, Ivor Wai-Hung; Chia, Liang-Tien, Sparse representation with kernels, IEEE Transactions on Image Processing, 22, 2, 423-434 (2013) · Zbl 1373.94126
[16] Geng, B.; Tao, D.; Xu, C., DAML: Domain adaptation metric learning, IEEE Transactions on Image Processing, 20, 10, 2980-2989 (2011) · Zbl 1372.68222
[17] Gretton, A.; Harchaoui, Z.; Fukumizu, K.; Sriperumbudur, B., A fast, consistent kernel two-sample test, (Advances in neural information processing systems 22 (2010), MIT Press), 673-681
[18] Karam, Lina J.; Zhu, Tong, Quality labeled faces in the wiild (QLFW): A database for studying face recognition in real-world enviroments, IVU lab Technical Report 03-2014-1 (2014), Arizona State University, Available online at: http://ivulab.asu.edu/qlfw
[19] Liu, Wei; Wang, Jun; Chang, Shih-Fu, Robust and scalable graph-based semi-supervised learning, Proceedings of the IEEE, 100, 9, 2624-2638 (2012)
[20] Long, Mingsheng, Transfer Sparse Coding for Robust Image Representation, (2013 IEEE conference on computer vision and pattern recognition (CVPR) (2013), IEEE)
[22] Mansour, Y.; Mohri, M.; Rostamizadeh, A., Domain adaptation with multiple sources, (Advances in neural information processing systems 21 (2009), MIT Press: MIT Press Cambridge, MA), 1041-1048
[24] Nie, F.; Xu, D.; Tsang, I. W.-H.; Zhang, C., Flexible manifold embedding: A framework for semi-supervised and unsupervised dimension reduction, IEEE Transactions on Image Processing, 19, 7, 1921-1932 (2010) · Zbl 1371.94276
[25] Pan, S. J.; Tsang, I. W.; Kwok, J. T.; Yang, Q., Domain adaptation via transfer component analysis, IEEE Transactions on Neural Networks, 22, 2, 199-210 (2011)
[26] Pan, S. J.; Yang, Q., A survey on transfer learning, IEEE Transactions on Knowledge and Data Engineering, 22, 10, 1345-1359 (2010)
[29] Rosenstein, M. T.; Marx, Z.; Kaelbling, L. P., To transfer or not to transfer, (Advances in neural information processing systems (2005), MIT Press: MIT Press Cambridge, MA)
[30] Schölkopf, B.; Smola, A. J., Learning with kernels (2002), MIT Press: MIT Press Cambridge, MA
[31] Schweikert, G.; Widmer, C.; Schölkopf, B.; Rätsch, G., An empirical analysis of domain adaptation algorithms for genomic sequence analysis, (Advances in neural information processing systems 21 (2009), MIT Press: MIT Press Cambridge, MA), 1433-1440
[33] Shekhar, Sumit, Joint sparsity-based robust multimodal biometrics recognition, (Computer vision-ECCV 2012. workshops and demonstrations (2012), Springer: Springer Berlin, Heidelberg)
[34] Shekhar, S.; Patel, V. M.; Nasrabadi, N. M.; Chellappa, R., Joint sparse representation for robust multimodal biometrics recognition, IEEE Transactions on Pattern Analysis and Machine Intelligence, 36, 1, 113-126 (2014)
[35] Sonnenburg, S.; RäARJKSRh, G.; Schäfer, C.; Schölkopf, B., Large scale multiple kernel learning, The Journal of Machine Learning Research, 7, 1531-1565 (2006) · Zbl 1222.90072
[36] Tao, Jianwen; Chung, Korris Fu-Lai; Wang, Shitong, On minimum distribution discrepancy support vector machine for domain adaptation, Pattern Recognition, 45, 11, 3962-3984 (2012) · Zbl 1242.68252
[37] Tao, JianWen; Chung, FuLai; Wang, ShiTong, A kernel learning framework for domain adaptation learning, Science China Information Sciences, 55, 9, 1983-2007 (2012) · Zbl 1270.68254
[38] Tao, JianWen; Hu, Wenjun; Wang, Shitong, Sparsity regularization label propagation for domain adaptation learning, Neurocomputing, 139, 202-219 (2014)
[39] Wagner, A.; Wright, J.; Ganesh, A.; Zhou, Z.; Mobahi, H.; Ma, Y., Towards a practical face recognition system: Robust alignment and illumination via sparse representation, IEEE Transactions on Pattern Analysis and Machine Intelligence, 34, 2, 372-386 (2012)
[40] Wang, J.; Wang, F.; Zhang, C.; Shen, H. C.; Quan, L., Linear neighborhood propagation and its applications, IEEE Transactions on Pattern Analysis and Machine Intelligence, 31, 9, 1600-1615 (2009)
[41] Wang, F.; Zhang, C., Label propagation through linear neighborhoods, IEEE Transactions on Knowledge and Data Engineering, 20, 1, 55-67 (2008)
[42] Wright, J.; Ma, Y.; Mairal, J., Sparse representation for computer vision and pattern recognition, Proceedings of the IEEE, 98, 6, 1031-1044 (2010)
[43] Wright, J.; Yang, A.; Sastry, S.; Ma, Y., Robust face recognition via sparse representation, IEEE Transactions on Pattern Analysis and Machine Intelligence, 31, 2, 210-227 (2009)
[44] Yang, Yang, Discriminative nonnegative spectral clustering with out-of-sample extension, IEEE Transactions on Knowledge and Data Engineering, 25, 8, 1760-1771 (2013)
[46] Yang, J.; Zhang, Y., Alternating direction algorithms for l1 problems in compressive sensing, SIAM Journal on Scientific and Statistical Computing, 33, 250-278 (2011) · Zbl 1256.65060
[49] Zheng, Miao, Graph regularized sparse coding for image representation, IEEE Transactions on Image Processing, 20, 5, 1327-1336 (2011) · Zbl 1372.94314
[50] Zhou, D.; Bousquet, O.; Lal, T.; Weston, J.; Schölkopf, B., Learning with local and global consistency, (Advances in neural information processing systems 16 (2004))
[51] Zhu, X., Semi-supervised learning literature survey, computer sciences Technical Report 1530 (2005), University of Wisconsin-Madison
[52] Zhuang, Liansheng, Non-negative low rank and sparse graph for semi-supervised learning, (2012 IEEE conference on computer vision and pattern recognition (CVPR) (2012), IEEE)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.