Recognizing faces prone to occlusions and common variations using optimal face subgraphs. (English) Zbl 1410.94012
Summary: An intuitive graph optimization face recognition approach called harmony search oriented-EBGM (HSO-EBGM) inspired by the classical elastic bunch graph matching (EBGM) graphical model is proposed in this contribution. In the proposed HSO-EBGM, a recent evolutionary approach called harmony search optimization is tailored to automatically determine optimal facial landmarks. A novel notion of face subgraphs have been formulated with the aid of these automated landmarks that maximizes the similarity entailed by the subgraphs. For experimental evaluation, two sets of de facto databases (i.e., AR and face recognition grand challenge (FRGC) ver2.0) are used to validate and analyze the behavior of the proposed HSO-EBGM in terms of number of subgraphs, varying occlusion sizes, face images under controlled/ideal conditions, realistic partial occlusions, expression variations and varying illumination conditions. For a number of experiments, results justify that the HSO-EBGM shows improved recognition performance when compared to recent state-of-the-art face recognition approaches.
MSC:
| 94A08 | Image processing (compression, reconstruction, etc.) in information and communication theory |
References:
| [1] | Abdullah, M. F.A.; Sayeed, M. S.; Muthu, K. S.; Bashier, H. K.; Azman, A.; Ibrahim, S. Z., Face recognition with symmetric local graph structure (slgs), Expert Syst. Appl., 41, 14, 6131-6137 (2014) |
| [2] | Abdulrahman, M.; Gwadabe, T. R.; Abdu, F. J.; Eleyan, A., Gabor wavelet transform based facial expression recognition using pca and lbp, Proceedings of the 2014 Twenty Second IEEE Signal Processing and Communications Applications Conference (SIU), 2265-2268 (2014), IEEE |
| [3] | Abual-Rub, M. S.; Al-Betar, M. A.; Abdullah, R.; Khader, A. T., A hybrid harmony search algorithm for ab initio protein tertiary structure prediction, Netw. Model. Anal. Health Inf. Bioinform., 1, 3, 69-85 (2012) |
| [4] | Al-Betar, M. A.; Doush, I. A.; Khader, A. T.; Awadallah, M. A., Novel selection schemes for harmony search, Appl. Math. Comput., 218, 10, 6095-6117 (2012) · Zbl 1246.65021 |
| [5] | Al-Betar, M. A.; Khader, A. T., A harmony search algorithm for university course timetabling, Ann. OR, 194, 1, 3-31 (2012) · Zbl 1251.90310 |
| [6] | Al-Betar, M. A.; Khader, A. T.; Doush, I. A., Memetic techniques for examination timetabling, Ann. OR, 218, 1, 23-50 (2014) · Zbl 1301.90024 |
| [7] | Al-Betar, M. A.; Khader, A. T.; Zaman, M., University course timetabling using a hybrid harmony search metaheuristic algorithm, IEEE Trans. Syst. Man Cybern Part C Appl. Rev., 42, 5, 664-681 (2012) |
| [8] | Alia, O.; Mandava, R., The variants of the harmony search algorithm: an overview, Artif. Intell. Rev., 36, 49-68 (2011) |
| [9] | Alkareem, Y. A.Z. A.; Venkat, I.; Al-Betar, M. A.; Khader, A. T., Edge preserving image enhancement via harmony search algorithm, Proceedings of the Fourth Conference on Data Mining and Optimization, DMO 2012, Langkawi, Malaysia, 47-52 (2012) |
| [10] | Azeem, A.; Sharif, M.; Raza, M.; Murtaza, M., A survey: face recognition techniques under partial occlusion., Int. Arab. J. Inf. Technol., 11, 1, 1-10 (2014) |
| [11] | Bolme, D. S., Thesis On Elastic Bunch Graph Matching (2003), Colorado State University Fort Collins, Master’s thesis |
| [12] | Borgi, M. A.; Labate, D.; El Arbi, M.; Amar, C. B., Sparse multi-stage regularized feature learning for robust face recognition, Expert Syst. Appl., 42, 1, 269-279 (2015) |
| [13] | Chen, W.; Gao, Y., Face recognition using ensemble string matching, IEEE Trans. Image Process., 22, 12, 4798-4808 (2013) · Zbl 1373.94078 |
| [14] | Deng, Y.; Dai, Q.; Zhang, Z., Graph Laplace for occluded face completion and recognition, IEEE Trans. Image Process., 20, 8, 2329-2338 (2011) · Zbl 1372.68273 |
| [15] | Ekenel, H. K.; Stiefelhagen, R., Why is facial occlusion a challenging problem?, Advances in Biometrics, 5558, 299-308 (2009), Springer Berlin Heidelberg |
| [16] | Ensari, T.; Chorowski, J.; Zurada, J., Occluded face recognition using correntropy-based nonnegative matrix factorization, Proceedings of the 2012 Eleventh International Conference on Machine Learning and Applications (ICMLA), vol. 1, 606-609 (2012) |
| [17] | Gao, J.-q.; Fan, L.-y.; Xu, L.-z., Median null (sw)-based method for face feature recognition, Appl. Math. Comput., 219, 12, 6410-6419 (2013) · Zbl 1410.68334 |
| [18] | Gao, Y.; Leung, M. K., Face recognition using line edge map, IEEE Trans. Pattern Anal. Mach. Intell., 24, 6, 764-779 (2002) |
| [19] | Geem, Z. W., Optimal scheduling of multiple dam system using harmony search algorithm, Computational and Ambient Intelligence, 316-323 (2007), Springer |
| [20] | Geem, Z. W., Novel derivative of harmony search algorithm for discrete design variables, Appl. Math. Comput., 199, 1, 223-230 (2008) · Zbl 1146.90501 |
| [21] | Geem, Z. W.; Kim, J. H.; Loganathan, G., A new heuristic optimization algorithm: harmony search, Simulation, 76, 2, 60-68 (2001) |
| [23] | Kanan, H. R.; Faez, K., Recognizing faces using adaptively weighted sub-Gabor array from a single sample image per enrolled subject, Image Vis. Comput., 28, 3, 438-448 (2010) |
| [24] | Kanan, H. R.; Faez, K.; Gao, Y., Face recognition using adaptively weighted patch pzm array from a single exemplar image per person, Pattern Recognit., 41, 12, 3799-3812 (2008) · Zbl 1173.68669 |
| [25] | Kumar, D., Harmony search algorithm for feature selection in face recognition, Computational Intelligence and Information Technology, 554-559 (2011), Springer |
| [26] | Lades, M.; Vorbruggen, J.; Buhmann, J.; Lange, J.; Von Der Malsburg, C.; Wurtz, R.; Konen, W., Distortion invariant object recognition in the dynamic link architecture, IEEE Trans. Comput., 42, 3, 300-311 (1993) |
| [27] | Lee, K.; Geem, Z., A new structural optimization method based on the harmony search algorithm, Comput. Struct., 82, 9-10, 781-798 (2004) |
| [28] | Li, X. X.; Dai, D. Q.; Zhang, X. F.; Ren, C. X., Structured sparse error coding for face recognition with occlusion, IEEE Trans. Image Process., 22, 5, 1889-1900 (2013) · Zbl 1373.94240 |
| [29] | Manjarres, D.; Landa-Torres, I.; Gil-Lopez, S.; Del Ser, J.; Bilbao, M.; Salcedo-Sanz, S.; Geem, Z., A survey on applications of the harmony search algorithm, Eng. Appl. Artif. Intell., 26, 8, 1818-1831 (2013) |
| [30] | Martinez, A. M., Recognizing imprecisely localized, partially occluded, and expression variant faces from a single sample per class, IEEE Trans. Pattern Anal. Mach. Intell., 24, 6, 748-763 (2002) |
| [31] | Martinez, A. M., The AR face database, CVC Technical Report, 24 (1998) |
| [32] | Min, R.; Hadid, A.; Dugelay, J.-L., Improving the recognition of faces occluded by facial accessories, 2011 IEEE International Conference on Automatic Face & Gesture Recognition and Workshops (FG 2011), 442-447 (2011), IEEE |
| [33] | Phillips, P. J.; Flynn, P. J.; Scruggs, T.; Bowyer, K. W.; Chang, J.; Hoffman, K.; Marques, J.; Min, J.; Worek, W., Overview of the face recognition grand challenge, Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2005, vol. 1, 947-954 (2005), IEEE |
| [34] | Phillips, P. J.; Moon, H.; Rizvi, S.; Rauss, P. J., The Feret evaluation methodology for face-recognition algorithms, IEEE Trans. Pattern Anal. Mach. Intell, 22, 10, 1090-1104 (2000) |
| [35] | Sawalha, R.; Doush, I. A., Face recognition using harmony search-based selected features., Int. J. Hybrid Inf. Technol., 5, 2, 1-16 (2012) |
| [36] | Senaratne, R.; Halgamuge, S.; Hsu, A., Face recognition by extending elastic bunch graph matching with particle swarm optimization, J. Multimed., 4, 4, 204-214 (2009) |
| [37] | Sinha, P.; Balas, B.; Ostrovsky, Y.; Russell, R., Face recognition by humans: Nineteen results all computer vision researchers should know about, Proc. IEEE, 94, 11, 1948-1962 (2006) |
| [38] | Venkat, I.; Khader, A. T.; Subramanian, K.; Wilde, P. D., Recognizing occluded faces by exploiting psychophysically inspired similarity maps, Pattern Recognit. Lett., 34, 8, 903-911 (2013) |
| [39] | Wei, X.; Li, C.-T.; Lei, Z.; Yi, D.; Li, S. Z., Dynamic image-to-class warping for occluded face recognition, IEEE Trans. Inf. Forensics Secur., 9, 12, 2035-2050 (2014) |
| [40] | Wiskott, L.; Fellous, J.-M.; Kuiger, N.; Von der Malsburg, C., Face recognition by elastic bunch graph matching, IEEE Trans. Pattern Anal. Mach. Intell., 19, 7, 775-779 (1997) |
| [41] | Wright, J.; Yang, A.; Ganesh, A.; Sastry, S.; Ma, Y., Robust face recognition via sparse representation, IEEE Trans. Pattern Anal. Mach. Intell., 31, 2, 210-227 (2009) |
| [42] | Xiaorong, P.; Zhihu, Z.; Heng, T.; Tai, L., Partially occluded face recognition using subface hidden markov models, Proceedings of the 2012 Seventh International Conference on Computing and Convergence Technology (ICCCT), 720-725 (2012) |
| [43] | Yan, H.; Wang, P.; Chen, W. D.; Liu, J., Face Recognition Based on Gabor Wavelet Transform and Modular 2DPCA, International Conference on Power Electronics and Energy Engineering (PEEE 2015), 245-248 (2015) |
| [44] | Yang, A.; Zhou, Z.; Balasubramanian, A.; Sastry, S.; Ma, Y., Fast \(ℓ_1\)- minimization algorithms for robust face recognition, IEEE Trans. Image Process., 22, 8, 3234-3246 (2013) |
| [45] | Zhao, Y.; Liu, Y.; Liu, Y.; Zhong, S.; Hua, K. A., Face recognition from a single registered image for conference socializing, Expert Syst. Appl., 42, 3, 973-979 (2015) |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
