Recognition of dynamic hand gestures. (English) Zbl 1035.68106
Summary: This paper is concerned with the problem of recognition of dynamic hand gestures. We have considered gestures which are sequences of distinct hand poses. In these gestures hand poses can undergo motion and discrete changes. However, continuous deformations of the hand shapes are not permitted. We have developed a recognition engine which can reliably recognize these gestures despite individual variations. The engine also has the ability to detect start and end of gesture sequences in an automated fashion. The recognition strategy uses a combination of static shape recognition (performed using contour discriminant analysis), Kalman filter based hand tracking and a HMM based temporal characterization scheme. The system is fairly robust to background clutter and uses skin color for static shape recognition and tracking. A real time implementation on standard hardware is developed. Experimental results establish the effectiveness of the approach.
MSC:
| 68T10 | Pattern recognition, speech recognition |
References:
| [1] | Pavlovic, V. I.; Sharma, R.; Huang, T. S., Visual interpretation of hand gestures for human-computer interactiona review, IEEE Trans. Pattern Anal. Mach. Intell., 19, 7, 677-695 (1997) |
| [2] | J.M. Rehg, T. Kanade, Digiteyes: vision-based human hand tracking, Tech. Rep. CMU-CS-93-220, CMU, 1993.; J.M. Rehg, T. Kanade, Digiteyes: vision-based human hand tracking, Tech. Rep. CMU-CS-93-220, CMU, 1993. |
| [3] | Cootes, T. F.; Taylor, C. J.; Cooper, D. H.; Graham, J., Active shape models—their training and application, Comput. Vision Image Understand., 61, 1, 38-59 (1995) |
| [4] | J. Davis, M. Shah, Recognizing hand gestures, in: Proceedings of the European Conference on Computer Vision, ECCV, 1994, pp. 331-340.; J. Davis, M. Shah, Recognizing hand gestures, in: Proceedings of the European Conference on Computer Vision, ECCV, 1994, pp. 331-340. |
| [5] | Blake, A.; Isard, M.; Reynard, D., Learning to track the visual motion of contours, Artif. Intell., 78, 1-2, 179-212 (1995) · Zbl 1497.68484 |
| [6] | M.A. Isard, Visual motion analysis by probabilistic propagation of conditional density, Ph.D. Thesis, Robotics Research Group, University of Oxford, September 1998.; M.A. Isard, Visual motion analysis by probabilistic propagation of conditional density, Ph.D. Thesis, Robotics Research Group, University of Oxford, September 1998. |
| [7] | Bobick, A. F.; Wilson, A. D., A state-based approach to the representation and recognition of gesture, IEEE Trans. Pattern Anal. Mach. Intell., 19, 12, 1235-1337 (1997) |
| [8] | T.E. Starner, A. Pentland, Real-time American sign language recognition from video using hidden Markov models, Tech. Rep. 375, MIT Media Lab Vision and Modelling Group, 1995.; T.E. Starner, A. Pentland, Real-time American sign language recognition from video using hidden Markov models, Tech. Rep. 375, MIT Media Lab Vision and Modelling Group, 1995. |
| [9] | R. Kjeldsen, J. Kender, Visual hand gesture recognition for window system control, in: IWAFGR, 1995, pp. 184-188.; R. Kjeldsen, J. Kender, Visual hand gesture recognition for window system control, in: IWAFGR, 1995, pp. 184-188. |
| [10] | Zhao, M.; Quek, F. K.H.; Wu, Xindong, Rievlrecursive induction learning in hand gesture recognition, IEEE Trans. Pattern Anal. Mach. Intell., 20, 11, 1174-1185 (1998) |
| [11] | Lee, Hyeon-Kyu; H. Kim, Jin, An hmm-based threshold model approach for gesture recognition, IEEE Trans. Pattern Anal. Mach. Intell., 21, 10, 961-973 (1999) |
| [12] | Yoon, Ho-Sub; Soh, Jung; J. Bae, Younglae; Seung Yang, Hyun, Hand gesture recognition using combined features of location, angle, velocity, Pattern Recognition, 34, 1491-1501 (2001) · Zbl 0985.68741 |
| [13] | MacCormick, Blake, A probabilistic contour discriminant for object localization, in: Proceedings of the IEEE International Conference on Computer Vision (ICCV), 1998, pp. 390-395.; MacCormick, Blake, A probabilistic contour discriminant for object localization, in: Proceedings of the IEEE International Conference on Computer Vision (ICCV), 1998, pp. 390-395. |
| [14] | M. Agrawal, S. Sadhwani, S. Chaudury, S. Banerjee, Recognition of dynamic hand gestures, in: S. Chaudhury, S.K. Nayar (Eds.), Computer Vision, Graphics and Image Processing: Recent Advances, Viva Books Private Limited, 1999, pp. 179-184.; M. Agrawal, S. Sadhwani, S. Chaudury, S. Banerjee, Recognition of dynamic hand gestures, in: S. Chaudhury, S.K. Nayar (Eds.), Computer Vision, Graphics and Image Processing: Recent Advances, Viva Books Private Limited, 1999, pp. 179-184. |
| [15] | Rogers, D. F.; Adams, J. A., Mathematical Elements of Computer Graphics (1990), WCB/McGraw-Hill: WCB/McGraw-Hill New York |
| [16] | Rabiner, L. R., A tutorial on hidden Markov models and selected applications in speech recognition, Proc. IEEE, 77, 2, 257-286 (1989) |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
