Abstract
Dense crowd counting and modeling at different gatherings has ignited a new flame in the visual surveillance research community. There is a high possibility of mishappenings in the form of stampede, mob fighting at these gatherings and the administration is helpless in these scenarios. There is a requirement of analyzing the crowd to prevent these dangerous situations. The proposed work is a case study of Kumbh Mela which models the crowd counting in densely populated images. In the proposed work, the orthographic projection of the crowd is captured using a camera attached to a drone, to reduce the effect of occlusion and scaling which, otherwise, may get introduce during image acquisition process. The captured data is fed to a Convolutional Neural Network for training the model to count head of persons present in the frame. The results obtained from the trained model are validated using geometry and imaging techniques. The proposed model has achieved a mean-absolute-error of 94.3 and a mean-squared-error of 104.6 which seems to outperform the existing state-of-the-art models with respect to the reported performance parameters. The proposed model can be used as a viable solution in applications related to modeling the crowd behavior.
Similar content being viewed by others
Notes
Record 120 million take dip as Maha Kumbh fest ends. Khaleej Times. 12 March 2013.
References
Boominathan L, Kruthiventi SS, Babu RV (2016) Crowdnet: a deep convolutional network for dense crowd counting. In proceedings of the 2016 ACM on multimedia conference, ACM, pp 640-644
Chan AB, Liang ZSJ, Vasconcelos N (2008) Privacy preserving crowd monitoring: Counting people without people models or tracking, in: Computer Vision and Pattern Recognition, CVPR 2008. IEEE conference on, IEEE, pp 1–7
Chen K, Loy CC, Gong S, Xiang T (2012) Feature mining for localised crowd counting. In: European conference on computer vision
Chen K, Gong S, Xiang T, Change Loy C (2013) Cumulative attribute space for age and crowd density estimation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2467–2474
Csurka G, Dance C, Fan L, Willamowski J, Bray C (2004) Visual categorization with bags of keypoints. In: Workshop on statistical learning in computer vision, ECCV, vol 1, no. 1-22, pp 1-2
Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection In: Computer Vision and Pattern Recognition, CVPR 2005. IEEE computer society conference on, IEEE. pp 886–893
Dollar P, Wojek C, Schiele B, Perona P (2012) Pedestrian detection: an evaluation of the state of the art. IEEE Trans Pattern Anal Mach Intell 34:743–761
Felzenszwalb P, McAllester D, Ramanan D (2008) A discriminatively trained, multiscale, deformable part model. In computer vision and pattern recognition, 2008. CVPR 2008. IEEE conference on, IEEE, pp 1-8
Fu M, Xu P, Li X, Liu Q, Ye M, Zhu C (2015) Fast crowd density estimation with convolutional neural networks. Eng Appl Artif Intell 43:81–88
Gall J, Yao A, Razavi N, Van Gool L, Lempitsky V (2011) Hough forests for object detection, tracking, and action recognition. IEEE Trans Pattern Anal Mach Intell 33:2188–2202
Ge W, Collins RT (2009) Marked point processes for crowd counting, in: Computer Vision and Pattern Recognition, CVPR 2009. IEEE conference on, IEEE, pp 2913–2920
Han K, Wan W, Yao H, Hou L (2017) Image crowd counting using convolutional neural network and Markov random field. arXiv preprint arXiv:1706.03686
Hu Y, Chang H, Nian F, Wang Y, Li T (2016) Dense crowd counting from still images with convolutional neural networks. J Vis Commun Image Represent 38:530–539
Idrees H, Saleemi I, Seibert C, Shah M (2013) Multi-source multiscale counting in extremely dense crowd images. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2547–2554
Kang D, Ma Z, Chan AB (2017) Beyond counting: comparisons of density maps for crowd analysis tasks-counting, detection, and tracking. arXiv:1705.10118
Kong D, Gray D, Tao H (2006) August. A viewpoint invariant approach for crowd counting. In 18th International Conference on Pattern Recognition (ICPR'06), IEEE, 3:1187–1190
Kumagai S, Hotta K, Kurita T (2017) Mixture of counting cnns: adaptive integration of cnns specialized to specific appearance for crowd counting. arXiv preprint arXiv:1703.09393
Lempitsky V, Zisserman A (2010) Learning to count objects in images, in: advances in neural information processing systems, pp 1324–1332
Li Y, Zhang X, Chen D (2018) Csrnet: dilated convolutional neural networks for understanding the highly congested scenes. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1091-1100
Liu L, Amirgholipour S, Jiang J, Jia W, Zeibots M, He X (2019) Performance-enhancing network pruning for crowd counting. Neurocomputing
Loy CC, Chen K, Gong S, Xiang T (2013) Crowd counting and profiling: methodology and evaluation. In: Modeling, simulation and visual analysis of crowds. Springer, pp 347–382
Marsden M, McGuiness K, Little S, O’Connor NE (2016) Fully convolutional crowd counting on highly congested scenes. arXiv:1612.00220
Miao Y, Han J, Gao Y, Zhang B (2019) ST-CNN: spatial-temporal convolutional neural network for crowd counting in videos. Pattern Recogn Lett 125:113–118
Onoro-Rubio D, López-Sastre RJ (2016) Towards perspective-free object counting with deep learning, in: European conference on computer vision, Springer, pp 615–629.
Oren M, Papageorgiou C, Sinha P, Osuna E, Poggio T (1997) Pedestrian detection using wavelet templates. In computer vision and pattern recognition, 1997. Proceedings., 1997 IEEE computer society conference, IEEE, pp 193-199
Paragios N, Ramesh V (2001) A mrf-based approach for real-time subway monitoring, in: computer vision and pattern recognition, CVPR 2001. Proceedings of the 2001 IEEE computer society conference on, IEEE, pp I–1034
Pham VQ, Kozakaya T, Yamaguchi O, Okada R (2015) Count forest: co-voting uncertain number of targets using random forest for crowd density estimation. In: Proceedings of the IEEE international conference on computer vision, pp 3253–3261
Rodriguez M, Laptev I, Sivic J, Audibert JY (2011) Density-aware person detection and tracking in crowds. In computer vision (ICCV), 2011 IEEE international conference on, IEEE, pp 2423-2430
Ryan D, Denman S, Fookes C, Sridharan S (2009) Crowd counting using multiple local features, in: digital image computing: techniques and applications, 2009. DICTA’09., IEEE, pp 81–88
Sabzmeydani P, Mori G (2007) Detecting pedestrians by learning shapelet features, in: computer vision and pattern recognition. CVPR’07. IEEE Conference on, IEEE, pp 1–8
Sam DB, Surya S, Babu RV (2017) Switching convolutional neural network for crowd counting. In: Proceedings of the IEEE conference on computer vision and pattern recognition
Shang C, Ai H, Bai B (2016) End-to-end crowd counting via joint learning local and global count. In Image Processing (ICIP), 2016 IEEE International Conference on, IEEE, pp 1215–1219
Sindagi V, Patel V (2017) Cnn-based cascaded multi-task learning of high-level prior and density estimation for crowd counting, in: advanced video and signal based surveillance (AVSS). 2017 IEEE international conference on, IEEE
Viola P, Jones MJ (2004) Robust real-time face detection. Int J Comput Vis 57:137–154
Viola P, Jones MJ, Snow D (2005) Detecting pedestrians using patterns of motion and appearance. Int J Comput Vis 63:153–161
Walach E, Wolf L (2016) Learning to count with cnn boosting. In: European conference on computer vision, Springer. pp 660–676
Wang Y, Zou Y (2016) Fast visual object counting via example-based density estimation, in: image processing (ICIP). 2016 IEEE international conference on, IEEE, pp 3653–3657
Wang C, Zhang H, Yang L, Liu S, Cao X (2015) Deep people counting in extremely dense crowds. In: Proceedings of the 23rd ACM international conference on multimedia, ACM, pp 1299–1302.
Wu B, Nevatia R (2005) Detection of multiple, partially occluded humans in a single image by bayesian combination of edgelet part detectors. In: Computer Vision, ICCV 2005. Tenth IEEE international conference on, IEEE, pp 90–97
Xu B, Qiu G (2016) Crowd density estimation based on rich features and random projection forest, In: 2016 IEEE winter conference on applications of computer vision (WACV), IEEE, pp 1–8
Xu M, Ge Z, Jiang X, Cui G, Zhou B, Xu C (2019) Depth information guided crowd counting for complex crowd scenes. Pattern Recogn Lett
Yao H, Han K, Wan W, Hou L (2017) Deep spatial regression model for image crowd counting. arXiv preprint arXiv:1710.09757
Zhang C, Li H, Wang X, Yang X (2015) Cross-scene crowd counting via deep convolutional neural networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 833–841
Zhang Y, Zhou D, Chen S, Gao S, Ma Y (2016) Single image crowd counting via multi-column convolutional neural network. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 589–597
Zhang C, Kang K, Li H, Wang X, Xie R, Yang X (2016) Data driven crowd understanding: a baseline for a large-scale crowd dataset. IEEE Trans Multimedia 18:1048–1061
Zhang L, Shi M, Chen Q (2018) Crowd counting via scale-adaptive convolutional neural network. In: 2018 IEEE winter conference on applications of computer vision (WACV), IEEE, pp 1113-1121
Zhao T, Nevatia R, Wu B (2008) Segmentation and tracking of multiple humans in crowded environments. IEEE Trans Pattern Anal Mach Intell 30:1198–1211
Acknowledgements
This work has been supported by the Kumbh Mela Police, Kumbh Mela, Prayagraj, Uttar Pradesh. We would like to specially acknowledge, Mr. K.P. Singh, DIG, Kumbh Mela, Prayagraj for allowing us to collect video data through drone cameras. We are also thankful to the reviewers for their constructive suggestions.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Pandey, A., Pandey, M., Singh, N. et al. KUMBH MELA: a case study for dense crowd counting and modeling. Multimed Tools Appl 79, 17837–17858 (2020). https://doi.org/10.1007/s11042-020-08754-4
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-020-08754-4