Abstract
Contour tracking can be implemented by measuring the probability distributions (e.g. intensity, color and texture) of both interior and exterior regions of an object contour. Choosing a suitable distance metric for measuring the (dis)similarity between two distributions significantly influences the tracking performance. Most existing contour tracking methods, however, utilize a predefined metric which may not be appropriate for measuring the distributions. This paper presents a novel variational level set framework for contour tracking. The image energy functional is modeled by the distance between the foreground distribution and the given template, divided by the distance between the background distribution and the template. The form of the distance between two distributions is represented by the quadratic distance (Rubner et al. in Int J Comput Vis 40(2):99–121, 2000). To obtain the more robust tracking results, a distance metric learning algorithm is employed to achieve the similarity matrix for the quadratic distance. In addition, a distance between the evolving contour and the zero level set of the reference shape function is adopted as the shape prior to constrain the contour evolution process. Experiments on several video sequences prove the effectiveness and robustness of our method.
Similar content being viewed by others
Notes
More formally, Eq. (1) defines a pseudo-metric. A pseudo-metric is a metric except that \(d_{\user2{M}}(U,V) = 0\) does not imply that U = V.
References
Rubner Y, Tomasi C, Guibas L (2000) The earth mover’s distance as a metric for image retrieval. Int J Comput Vis 40(2):99–121
Isard M, Blake A (1998) Condensation conditional density propagation for visual tracking. International journal of computer vision 29(1):5–28
Li P, Zhang T, Ma B (2004) Unscented Kalman filter for visual curve tracking. Image Vis Comput 22(2):157–164
Comaniciu D, Ramesh V, Meer P (2003) Kernel-based object tracking. IEEE Trans Pattern Anal Mach Intell 25(5):564–575
Yilmaz A (2011) Kernel Based Object Tracking Using Asymmetric Kernels with Adaptive Scale and Orientation Selection. Mach Vis Appl 22(2):255–268
Li X, Hu W, Zhang Z, Zhang X, Zhu M, Cheng J (2008) Visual tracking via incremental log-euclidean riemannian subspace learning. In: Proceedings of IEEE conference on computer vision and pattern recognition (CVPR). IEEE, 1–8
Ross D, Lim J, Lin R, Yang M (2008) Incremental learning for robust visual tracking. Int J Comput Vis 77(1):125–141
Collins R, Liu Y, Leordeanu M (2005) Online selection of discriminative tracking features. IEEE Trans Pattern Anal Mach Intell 27(10):1631–1643
Babenko B, Yang M, Belongie S (2011) Robust object tracking with online multiple instance learning. IEEE Trans Pattern Anal Mach Intell 33(8):1619–1632
Grabner H, Leistner C, Bischof H (2008) Semi-supervised on-line boosting for robust tracking. In: Proceedings of the 10th European conference on computer vision (ECCV), pp 234–247
Breitenstein M, Reichlin F, Leibe B, Koller-Meier E, Van Gool L (2011) Online multi-person tracking-by-detection from a single, uncalibrated camera. IEEE Trans Pattern Anal Mach Intell 33(9):1820–1833
Mei X, Ling H (2011) Robust visual tracking and vehicle classification via sparse representation. IEEE Trans Pattern Anal Mach Intell 33(11):2259–2272
Yilmaz A, Javed O, Shah M (2006) Object tracking: A survey. Acm Computing Surveys (CSUR) 38(4):13
Cannons K (2008) A review of visual tracking. Technical report, Technical Report CSE-2008-07, York University, Department of Computer Science and Engineering
Paragios N, Deriche R (2005) Geodesic active regions and level set methods for motion estimation and tracking. Comput Vis Image Underst 97(3):259–282
Cremers D (2006) Dynamical statistical shape priors for level set-based tracking. IEEE Trans Pattern Anal Mach Intell 28(8):1262–1273
Bibby C, Reid I (2010) Real-time tracking of multiple occluding objects using level sets. In: Proceedings of IEEE conference on computer vision and pattern recognition (CVPR), pp 1307–1314
Freedman D, Zhang T (2004) Active contours for tracking distributions. IEEE Trans Image Process 13(4):518–526
Hager G, Dewan M, Stewart C (2004) Multiple kernel tracking with ssd. In: Proceedings of IEEE conference on computer vision and pattern recognition (CVPR), pp 790–797
Sandhu R, Georgiou T, Tannenbaum A (2008) Tracking with a new distribution metric in a particle filtering framework. Image Process: Mach Vis Appl 1:68130N
Elgammal A, Duraiswami R, Davis L (2003) Probabilistic tracking in joint feature-spatial spaces. In: Proceedings of IEEE conference on computer vision and pattern recognition (CVPR), pp 781–788
Jiang N, Liu W, Wu Y (2011) Learning adaptive metric for robust visual tracking. IEEE Trans Image Process 20(8):2288–2300
Ray N, Acton S (2004) Motion gradient vector flow: An external force for tracking rolling leukocytes with shape and size constrained active contours. IEEE Trans Med Imaging 23(12):1466–1478
Kass M, Witkin A, Terzopoulos D (1988) Snakes: Active contour models. Int J Comput Vis 1(4):321–331
Bibby C, Reid I (2008) Robust real-time visual tracking using pixel-wise posteriors. In: Proceedings of the 10th European conference on computer vision (ECCV), pp 831–844
Ma B, Wu Y (2011) Learning distribution metric for object contour tracking. In: 2011 International conference on multimedia technology (ICMT). IEEE, pp 3120–3123
Paragios N, Deriche R (2000) Geodesic active contours and level sets for the detection and tracking of moving objects. IEEE Trans Pattern Anal Mach Intell 22(3):266–280
Shi Y, Karl WC (2005) Real-time tracking using level sets. In: Proceedings of IEEE conference on computer vision and pattern recognition (CVPR), pp 34–41
Prisacariu VA, Reid I (2011) Nonlinear shape manifolds as shape priors in level set segmentation and tracking. In: Proceedings of IEEE conference on computer vision and pattern recognition (CVPR), pp 2185–2192
Rathi Y, Vaswani N, Tannenbaum A (2007) A generic framework for tracking using particle filter with dynamic shape prior. IEEE Trans Image Process 16(5):1370–1382
Fussenegger M, Roth P, Bischof H, Deriche R, Pinz A (2009) A level set framework using a new incremental, robust Active Shape Model for object segmentation and tracking. Image Vis Comput 27(8):1157–1168
Chockalingam P, Pradeep N, Birchfield S (2009) Adaptive fragments-based tracking of non-rigid objects using level sets. In: 2009 IEEE 12th international conference on computer vision, pp 1530–1537
Yilmaz A, Li X, Shah M (2004) Contour-based object tracking with occlusion handling in video acquired using mobile cameras. IEEE Trans Pattern Anal Mach Intell 26(11):1531–1536
Xing E, Ng A, Jordan M, Russell S (2003) Distance metric learning with application to clustering with side-information. In: Advances in neural information processing systems, pp 505–512
Shalev-Shwartz S, Singer Y, Ng A (2004) Online and batch learning of pseudo-metrics. In: Proceedings of the twenty-first international conference on machine learning. ACM, 94
Weinberger K, Saul L (2009) Distance metric learning for large margin nearest neighbor classification. The Journal of Machine Learning Research 10:207–244
Goldberger J, Roweis S, Hinton G, Salakhutdinov R (2005) Neighbourhood components analysis. In: Advances in Neural Information Processing Systems. Volume 17:513–520
Globerson A, Roweis S (2006) Metric learning by collapsing classes. In: Advances in neural information processing systems, vol 18, pp 451–458
Dryden I, Mardia K (1998) Statistical shape analysis, vol 4. Wiley, New York
Zhang T, Freedman D (2003) Tracking objects using density matching and shape priors. In: 2003 Ninth IEEE international conference on computer vision (ICCV). IEEE, pp 1056–1062
Udupa J, Leblanc V, Zhuge Y, Imielinska C, Schmidt H, Currie L, Hirsch B, Woodburn J (2006) A framework for evaluating image segmentation algorithms. Comput Med Imaging Graph 30(2):75–87
Acknowledgments
The authors would like to thank both the editor and the reviewers for the invaluable comments and suggestions that help a great deal in improving our paper. This work was partially supported by the Chinese High-Tech Program under Grant No. 2009AA01Z323, and the Natural Science Foundation of China under Grant No. 90920009.
Author information
Authors and Affiliations
Corresponding author
Electronic supplementary material
Below is the link to the electronic supplementary material.
Supplementary material (AVI 2950 kb)
Supplementary material (AVI 2895 kb)
Rights and permissions
About this article
Cite this article
Wu, Y., Ma, B. Learning distance metric for object contour tracking. Pattern Anal Applic 17, 265–277 (2014). https://doi.org/10.1007/s10044-012-0306-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10044-012-0306-6