Point context: an effective shape descriptor for RST-invariant trajectory recognition. (English) Zbl 1386.68183
Summary: Motion trajectory recognition is important for characterizing the moving property of an object. The speed and accuracy of trajectory recognition rely on a compact and discriminative feature representation, and the situations of varying rotation, scaling, and translation have to be specially considered. In this paper, we propose a novel feature extraction method for trajectories. Firstly, a trajectory is represented by a proposed point context, which is a rotation-scale-translation invariant shape descriptor with a flexible tradeoff between the complexity and discrimination, yet we prove that it is a complete shape descriptor. Secondly, the point context is nonlinearly mapped to a subspace by kernel nonparametric discriminant analysis to get a compact feature representation, and thus a trajectory is projected to a low-dimensional feature space. Experimental results show that the proposed trajectory feature demonstrates encouraging improvement than state-of-the-art methods.
MSC:
| 68T45 | Machine vision and scene understanding |
| 68U10 | Computing methodologies for image processing |
References:
| [1] | Bandera, J., Marfil, R., Bandera, A., Rodríguez, J.A., Molina-Tanco, L., Sandoval, F.: Fast gesture recognition based on a two-level representation. Pattern Recognit. Lett. 30(13), 1181-1189 (2009) · Zbl 1182.68150 · doi:10.1016/j.patrec.2009.05.017 |
| [2] | Barthélemy, Q., Larue, A., Mars, J.I.: Decomposition and dictionary learning for 3D trajectories. Signal Process. 98, 423-437 (2014) · doi:10.1016/j.sigpro.2013.12.004 |
| [3] | Bashir, F., Khokhar, A.: Curvature scale space based affine-invariant trajectory retrieval. In: Proceedings of INMIC 2004. IEEE 8th International Multitopic Conference, 2004. pp. 20-25. (2004) |
| [4] | Bashir, F., Khokhar, A., Schonfeld, D.: View-invariant motion trajectory-based activity classification and recognition. Multimed. Syst. 12(1), 45-54 (2006) · doi:10.1007/s00530-006-0024-2 |
| [5] | Baudat, G., Anouar, F.: Generalized discriminant analysis using a kernel approach. Neural Comput. 12(10), 2385-2404 (2000) · doi:10.1162/089976600300014980 |
| [6] | Belongie, S., Malik, J., Puzicha, J.: Shape matching and object recognition using shape contexts. IEEE Trans. Pattern Anal. Mach. Intell. 24(4), 509-522 (2002) · doi:10.1109/34.993558 |
| [7] | Button, K.S., Ioannidis, J.P., Mokrysz, C., Nosek, B.A., Flint, J., Robinson, E.S., Munafò, M.R.: Power failure: why small sample size undermines the reliability of neuroscience. Nat. Rev. Neurosci. 14(5), 365-376 (2013) · doi:10.1038/nrn3475 |
| [8] | Chen, C., Odobez, J.M.: We are not contortionists: coupled adaptive learning for head and body orientation estimation in surveillance video. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2012, pp. 1544-1551 (2012) |
| [9] | Chen, S., Zhang, J., Guan, Q., Liu, S.: Detection and amendment of shape distortions based on moment invariants for active shape models. Image Process. IET 5(3), 273-285 (2011) · doi:10.1049/iet-ipr.2007.0110 |
| [10] | Croitoru, A., Agouris, P., Stefanidis, A.: 3D trajectory matching by pose normalization. In: Proceedings of the 13th annual ACM International Workshop on Geographic information Systems, pp. 153-162. ACM (2005) · Zbl 1162.68640 |
| [11] | Deng, L.Y., Lee, D.L., Keh, H.C., Liu, Y.J.: Shape context based matching for hand gesture recognition. In: IET International Conference on Frontier Computing. Theory, Technologies and Applications, 2010, pp. 436-444. IET (2010) |
| [12] | Diaf, A., Boufama, B., Benlamri, R.: Non-parametric fishers discriminant analysis with kernels for data classification. Pattern Recognit. Lett. 34(5), 552-558 (2013) · doi:10.1016/j.patrec.2012.10.030 |
| [13] | Dryden, I.L., Mardia, K.V.: Statistical Shape Analysis, vol. 213, no. 6, pp. 663-669. John Wiley & Sons Ltd, Chichester (1998) · Zbl 0901.62072 |
| [14] | Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification. Wiley, New York (2012) · Zbl 0968.68140 |
| [15] | Faria, D.R., Dias, J.: 3D hand trajectory segmentation by curvatures and hand orientation for classification through a probabilistic approach. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) 2009, pp. 1284-1289 (2009) |
| [16] | Harding, P.R., Ellis, T.J.: Recognizing hand gesture using fourier descriptors. In: International Conference on Pattern Recognition (ICPR) 2004., vol. 3, pp. 286-289 (2004) |
| [17] | Hettich, S., Bay, S.: (1999). The Austilian Sign Language Dataset. http://kdd.ics.uci.edu/databases/auslan/auslan.data.html |
| [18] | Holte, M.B., Moeslund, T.B., Fihl, P.: View-invariant gesture recognition using 3D optical flow and harmonic motion context. Comput. Vision Image Underst. 114(12), 1353-1361 (2010) · doi:10.1016/j.cviu.2010.07.012 |
| [19] | Hung, K.C.: The generalized uniqueness wavelet descriptor for planar closed curves. IEEE Trans. Image Process. 9(5), 834-845 (2000) · Zbl 0962.94021 · doi:10.1109/83.841530 |
| [20] | Li, Z., Lin, D., Tang, X.: Nonparametric discriminant analysis for face recognition. IEEE Trans. Pattern Anal. Machine Intell. 31(4), 755-761 (2009) · doi:10.1109/TPAMI.2008.174 |
| [21] | Lin, W.Y., Hsieh, C.Y.: Kernel-based representation for 2D/3D motion trajectory retrieval and classification. Pattern Recognit. 46(3), 662-670 (2013) · doi:10.1016/j.patcog.2012.09.014 |
| [22] | Parkinson, B.: Global Positioning System: Theory and Applications. Progress in Astronautics and Aeronautics. AIAA, Washington, DC (1996) · doi:10.2514/4.866395 |
| [23] | Peng, B., Qian, G.: Online gesture spotting from visual hull data. IEEE Trans. Pattern Anal. Mach. Intell. 33(6), 1175-1188 (2011) · doi:10.1109/TPAMI.2010.199 |
| [24] | Pham, H.T., Kim, J.J., Won, Y.: A cost effective method for matching the 3D motion trajectories. In: IT Convergence and Security 2012, pp. 889-895. Springer (2013) |
| [25] | Qiao, Y., Liu, J., Tang, X.: Offline signature verification using online handwriting registration. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2007, pp. 1-8. IEEE (2007) |
| [26] | Refaeilzadeh, P.; Tang, L.; Liu, H.; Liu, L. (ed.); Özsu, MT (ed.), Cross-validation (2009), New York · Zbl 1367.94107 |
| [27] | Scholkopf, B., Smola, A.J.: Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. MIT Press, Cambridge (2001) |
| [28] | Shao, Z., Li, Y.: A new descriptor for multiple 3D motion trajectories recognition. In: International Conference on Robotics and Automation (ICRA) 2013, pp. 286-289. IEEE (2013) |
| [29] | Shin, M.C., Tsap, L.V., Goldgof, D.B.: Gesture recognition using bezier curves for visualization navigation from registered 3-D data. Pattern Recognit. 37(5), 1011-1024 (2004) · doi:10.1016/j.patcog.2003.11.007 |
| [30] | Srinivasan, P., Zhu, Q., Shi, J.: Many-to-one contour matching for describing and discriminating object shape. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2010, pp. 1673-1680. IEEE (2010) |
| [31] | Wang, H., Kläser, A., Schmid, C., Liu, C.: Dense trajectories and motion boundary descriptors for action recognition. Int. J. Comput. Vis. 103(1), 60-79 (2013) · doi:10.1007/s11263-012-0594-8 |
| [32] | Wang, Q., Chen, X., Zhang, L.G., Wang, C., Gao, W.: Viewpoint invariant sign language recognition. Comput. Vis. Image Underst. 108(1), 87-97 (2007) · doi:10.1016/j.cviu.2006.11.009 |
| [33] | Wu, S., Li, Y.F.: Flexible signature descriptions for adaptive motion trajectory representation, perception and recognition. Pattern Recognit. 42(1), 194-214 (2009) · Zbl 1162.68640 · doi:10.1016/j.patcog.2008.06.023 |
| [34] | Wu, X., Mao, X., Chen, L., Xue, Y., Compare, A.: View-invariant hand gesture recognition using nonparametric shape descriptor. In: International Conference on Pattern Recognition, 2014, p. 83. IEEE (2014) |
| [35] | Yang, J., Li, Y., Wang, K.: A new descriptor for 3D trajectory recognition via modified CDTW. In: IEEE International Conference on Automation and Logistics (ICAL), 2010, pp. 37-42. IEEE (2010) |
| [36] | Yang, J., Jin, Z., Yang, J., Zhang, D., Frangi, A.: Essence of kernel Fisher discriminant: KPCA plus LDA. Pattern Recognit. 37(10), 2097-2100 (2004) · doi:10.1016/j.patcog.2003.10.015 |
| [37] | Yang, J., Li, Y., Wang, K., Wu, Y., Altieri, G., Scalia, M.: Mixed signature: an invariant descriptor for 3D motion trajectory perception and recognition. Math. Prob. Eng. 2012(3), 1-29 (2012) · Zbl 1264.68193 |
| [38] | You, D., Hamsici, O.C., Martinez, A.M.: Kernel optimization in discriminant analysis. IEEE Trans. Pattern Anal. Mach. Intell. 33(3), 631-638 (2011) · doi:10.1109/TPAMI.2010.173 |
| [39] | Zhou, F., Torre, F.: Canonical time warping for alignment of human behavior. In: Advances in neural information processing systems, pp. 2286-2294 (2009) |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
