Moving object detection and shadow removing under changing illumination condition. (English) Zbl 1407.94052
Summary: Moving object detection is a fundamental step in video surveillance system. To eliminate the influence of illumination change and shadow associated with the moving objects, we proposed a local intensity ratio model (LIRM) which is robust to illumination change. Based on the analysis of the illumination and shadow model, we discussed the distribution of local intensity ratio. And the moving objects are segmented without shadow using normalized local intensity ratio via Gaussian mixture model (GMM). Then erosion is used to get the moving objects contours and erase the scatter shadow patches and noises. After that, we get the enhanced moving objects contours by a new contour enhancement method, in which foreground ratio and spatial relation are considered. At last, a new method is used to fill foreground with holes. Experimental results demonstrate that the proposed approach can get moving objects without cast shadow and shows excellent performance under various illumination change conditions.
MSC:
| 94A13 | Detection theory in information and communication theory |
References:
| [1] | Piccardi, M., Background subtraction techniques: a review, Proceedings of the IEEE International Conference on Systems, Man and Cybernetics (SMC ’04) · doi:10.1109/ICSMC.2004.1400815 |
| [2] | Sanin, A.; Sanderson, C.; Lovell, B. C., Shadow detection: a survey and comparative evaluation of recent methods, Pattern Recognition, 45, 4, 1684-1695 (2012) · doi:10.1016/j.patcog.2011.10.001 |
| [3] | Al-Najdawi, N.; Bez, H. E.; Singhai, J.; Edirisinghe, E. A., A survey of cast shadow detection algorithms, Pattern Recognition Letters, 33, 6, 752-764 (2012) · doi:10.1016/j.patrec.2011.12.013 |
| [4] | Prati, A.; Mikic, I.; Trivedi, M. M.; Cucchiara, R., Detecting moving shadows: algorithms and evaluation, IEEE Transactions on Pattern Analysis and Machine Intelligence, 25, 7, 918-923 (2003) · doi:10.1109/TPAMI.2003.1206520 |
| [5] | Zivkovic, Z.; van der Heijden, F., Efficient adaptive density estimation per image pixel for the task of background subtraction, Pattern Recognition Letters, 27, 7, 773-780 (2006) · doi:10.1016/j.patrec.2005.11.005 |
| [6] | Joshi, A. J.; Papanikolopoulos, N. P., Learning to detect moving shadows in dynamic environments, IEEE Transactions on Pattern Analysis and Machine Intelligence, 30, 11, 2055-2063 (2008) · doi:10.1109/TPAMI.2008.150 |
| [7] | Jung, C. R., Efficient background subtraction and shadow removal for monochromatic video sequences, IEEE Transactions on Multimedia, 11, 3, 571-577 (2009) · doi:10.1109/TMM.2009.2012924 |
| [8] | Shoaib, M.; Dragon, R.; Ostermann, J., Shadow detection for moving humans using gradient-based background subtraction, Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP ’09) · doi:10.1109/ICASSP.2009.4959698 |
| [9] | Cucchiara, R.; Grana, C.; Piccardi, M.; Prati, A., Detecting moving objects, ghosts, and shadows in video streams, IEEE Transactions on Pattern Analysis and Machine Intelligence, 25, 10, 1337-1342 (2003) · doi:10.1109/TPAMI.2003.1233909 |
| [10] | Salvador, E.; Cavallaro, A.; Ebrahimi, T., Cast shadow segmentation using invariant color features, Computer Vision and Image Understanding, 95, 2, 238-259 (2004) · doi:10.1016/j.cviu.2004.03.008 |
| [11] | Grest, D.; Frahm, J. M.; Koch, R., A color similarity measure for robust shadow removal in real time, Proceedings of the Vision, Modeling and Visualization (VMV ’03) |
| [12] | Horprasert, T.; Harwood, D.; Davis, L., A statistical approach for real-time robust background subtraction and shadow detection, Proceedings of the IEEE International Conference on Computer Vision (ICCV ’99), Frame Rate Workshop |
| [13] | Nadimi, S.; Bhanu, B., Physical models for moving shadow and object detection in video, IEEE Transactions on Pattern Analysis and Machine Intelligence, 26, 8, 1079-1087 (2004) · doi:10.1109/TPAMI.2004.51 |
| [14] | Huang, J. B.; Chen, C. S., Moving cast shadow detection using Physics-based features, Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPR ’09) · doi:10.1109/CVPRW.2009.5206629 |
| [15] | Martel-Brisson, N.; Zaccarin, A., Kernel-based learning of cast shadows from a physical model of light sources and surfaces for low-level segmentation, Proceedings of the 26th IEEE Conference on Computer Vision and Pattern Recognition (CVPR ’08) · doi:10.1109/CVPR.2008.4587447 |
| [16] | Chen, C. C.; Aggarwal, J. K., Human shadow removal with unknown light source, Proceedings of the 20th International Conference on Pattern Recognition (ICPR ’10) · doi:10.1109/ICPR.2010.589 |
| [17] | Hsieh, J. W.; Hu, W. F.; Chang, C. J.; Chen, Y. S., Shadow elimination for effective moving object detection by Gaussian shadow modeling, Image and Vision Computing, 21, 6, 505-516 (2003) · doi:10.1016/S0262-8856(03)00030-1 |
| [18] | Nicolas, H.; Pinel, J. M., Joint moving cast shadows segmentation and light source detection in video sequences, Signal Processing: Image Communication, 21, 1, 22-43 (2006) · doi:10.1016/j.image.2005.06.001 |
| [19] | Leone, A.; Distante, C., Shadow detection for moving objects based on texture analysis, Pattern Recognition, 40, 4, 1222-1233 (2007) · Zbl 1158.68474 · doi:10.1016/j.patcog.2006.09.017 |
| [20] | Zhang, W.; Fang, X. Z.; Yang, X. K.; Wu, Q. M. J., Moving cast shadows detection using ratio edge, IEEE Transactions on Multimedia, 9, 6, 1202-1213 (2007) · doi:10.1109/TMM.2007.902842 |
| [21] | Xiao, M.; Han, C. Z.; Zhang, L., Moving shadow detection and removal for traffic sequences, International Journal of Automation and Computing, 4, 1, 38-46 (2007) · doi:10.1007/s11633-007-0038-z |
| [22] | Stauder, J.; Mech, R.; Ostermann, J., Detection of moving cast shadows for object segmentation, IEEE Transactions on Multimedia, 1, 1, 65-76 (1999) · doi:10.1109/6046.748172 |
| [23] | Andersen, M. S.; Jensen, T.; Madsen, C. B., Estimation of dynamic light changes in outdoor scenes without the use of calibration objects, Proceedings of the 18th International Conference on Pattern Recognition (ICPR ’06) · doi:10.1109/ICPR.2006.504 |
| [24] | Lee, D. S., Effective Gaussian mixture learning for video background subtraction, IEEE Transactions on Pattern Analysis and Machine Intelligence, 27, 5, 827-832 (2005) · doi:10.1109/TPAMI.2005.102 |
| [25] | Heikkilä, M.; Pietikäinen, M., A texture-based method for modeling the background and detecting moving objects, IEEE Transactions on Pattern Analysis and Machine Intelligence, 28, 4, 657-662 (2006) · doi:10.1109/TPAMI.2006.68 |
| [26] | Xu, M.; Ellis, T., Colour-invariant motion detection under fast illumination changes, Proceedings of the 2nd European Workshop on Advanced Video-Based Surveillance Systems · doi:10.1007/978-1-4615-0913-4_8 |
| [27] | Pilet, J.; Strecha, C.; Fua, P., Making background subtraction robust to sudden illumination changes, Proceedings of the 10th European Conference on Computer Vision (ECCV ’08) · doi:10.1007/978-3-540-88693-8-42 |
| [28] | Choi, J.; Chang, H. J.; Yoo, Y. J.; Choi, J. Y., Robust moving object detection against fast illumination change, Computer Vision and Image Understanding, 116, 2, 179-193 (2012) · doi:10.1016/j.cviu.2011.10.007 |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
