Abstract
Rate control plays an important role in regulating bit streams in video coding. In order to obtain good coding performance, the hierarchical B prediction structure has been adopted in Multi-view Video Coding (MVC). However, the conventional rate control scheme is not efficient in the hierarchical B prediction structure. In this paper, we propose a rate control algorithm to address this problem. First, the accurate estimation of Mean Absolute Distortion (MAD) of the current frame is desired for both quantization parameter (QP) selection and Rate Distortion Optimization (RDO). Considering the hierarchical B structure, a bi-directional MAD prediction model is proposed to predict the MAD of the current frame by using the actual MADs of the encoded frames in the lower Temporal Layers (TLs). Second, the number of header bits has a close relationship with the TLs in the hierarchical B prediction structure. Therefore, we propose an enhanced prediction method in which a proportional relationship of the header bits is introduced if the frames are located in different TLs. Experimental results show that our proposed algorithm can achieve both accurate target bit rate and good coding performance.
Similar content being viewed by others
References
Chen Y, Pandit P, and Yea S (2009) WD 4 reference software for MVC (JMVC). ISO/IEC JTC1/SC29/WG11 and ITU-T Q6/SG16, Doc. JVT-AD207
Chi MC, Chen MJ, Hsu CT (2004) Region-of interest video coding by fuzzy control for h.263+ standards. In: IEEE Int Symp and Circuits Syst (ISCAS), pp 93–96
Cho YJ, Kuo CCJ, Kwon DK (2007) Gop-based rate control for h.264/svc with hierarchical B-pictures. In: IEEE IntInf. Hiding Multimed Signal Processing (IIHMSP), pp 387–390
Cho YJ, Liu JY, Kwon DK, and Kuo CCJ (2009) H.264/SVC temporal bit allocation with dependent distortion model. In: IEEE Int Conf Acoustics Speech Signal Processing (ICASSP), pp 641–644
Hu SD, Wang HL, Kwong S, Zhao TS, Kuo CCJ (2011) Rate control optimization for temporal-layer scalable video coding. IEEE Trans Circ Syst Video Technol 21(8):1152–1162
ISO/IEC JTC1/SC29/WG11 (2005) Survey of algorithms used for multi-view video coding (MVC). Doc. N6909
ITU-T Recommendation H.264 (2010) Advanced video coding for generic audio visual services
Lee HJ, Chiang TH, Zhang YQ (2000) Scalable rate control for MPEG-4 video. IEEE Trans Circ Syst Video Technol 10(6):878–894
Lee JY, Wey HC, Park DS (2011) A fast and efficient multi-view depth image coding method based on temporal and inter-view corrections of texture images. IEEE Trans Circ Syst Video Tech 21(12):1859–1868
Li ZG, An P, Yan Tao LF, Zhang ZY (2009) Macroblock layer rate control in multi-view video coding. J Appl Sci 27(5):502–507
Li M, Chang YL, Yang FZ, Wan S, Lin SX, Xiong LH (2009) Frame layer rate control for H.264/AVC with hierarchical B-frames. Signal Process: Image Commun 24:177–199
Li ZG, Pan F, Lim KP, Feng G, Lin X, Rahardja S (2003) Adaptive basic unit layer rate control for JVT. ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6, Doc. JVT-G012
Lim J, Kim J, Ngan KN (2003) Advanced rate control technologies for 3D-HDTV. IEEE Trans Consum Electron 49(4):1498–1507
Liu Y, Li ZG, Soh YC (2008) Rate control of H.264/AVC scalable extension. IEEE Trans Circ Syst Video Technol 18(1):116–121
Liu F, Xiong J, Fan JJ, Lin QJ (2011) Efficient rate control algorithm for multi-view video coding. China Commun:83–89
Merkle P, Müller K, Wiegand T (2010) 3D video: acquisition, coding, and display. IEEE Trans Consum Electron 56(2):946–950
Merkle P, Smolić A, Müller K, Wiegand T (2007) Efficient prediction structures for multiview video coding. IEEE Trans Circ Syst Video Tech 17(1):1461–1473
Müller K, Merkle P, Schwarz H (2006) Multiview video coding based on H.264/MPEG4-AVC using hierarchical B pictures. In: Picture Coding Symposium, pp 24–26
Natio S, Matsumoto S (1999) 34/35Mbps 3D-HDTV digital coding scheme using a modified motion compensation with disparity vectors. In: SPIE Vis Commun Image Process (VCIP), pp. 1082–1089
Park S, Sim DY (2009) An efficient rate-control algorithm for multi-view video coding. In: IEEE Int Symp Consum Electron (ISCE), pp 25–28
Seo CW, Kang JW, Han JK, Nguyen TQ (2010) Efficient bit allocation and rate control algorithms for hierarchical video coding. IEEE Trans Circ Syst Video Technol 20(9):1210–1223
Shen LQ, Liu Z, Zhang ZY (2011) A novel H.264 rate control algorithm with consideration of visual attention. Multimed Tools Appl. doi:10.1007/s11042-011-0893-z
Son NR, Shin YJ, Yoo JM, Lee GS (2006) A new macroblock-layer rate control for H.264/AVC using Quadratic R-D model. Lect Notes In Comput Sci 4319:822–831
Vetro A, Wiegand T, Sullivan GJ (2011) Overview of the stereo and multiview video coding extensions of the H.264/MPEG-4 AVC standard. Proc IEEE 99(4):626–642
Woo W, Ortega A (1999) Optimal blockwise dependent quantization for stereo image coding. IEEE Trans Circ Syst Video Technol 9(6):861–867
Xu L, Gao W, Ji XY, Zhao DB (2007) Rate control for hierarchical B-picture coding with scaling-factors. In: IEEE Int Symp and Circuits Syst (ISCAS), pp 27–30
Xu L, Kwong S, Zhao TS, Zhou Y (2011) Priority pyramid based bit allocation for multiview video coding. In: IEEE Vis Commun Image Processing (VCIP), pp 6–9
Yan T, An P, Shen LQ, Zhang Q, Zhang ZY (2009) Rate control algorithm for multi-view video coding based on correlation analysis. In: IEEE Symp On Photonic Opo electron (SOPO), pp 14–16
Yi XQ, Ling N (2006) Improved H.264 rate control by enhanced MAD-based frame complexity prediction. J Vis Commun Image Represent 17(2):407–424
Zeng HQ, Ma KK, Cai CH (2011) Fast mode decision for multiview video coding using mode correction. IEEE Trans Circ Syst Video Tech 21(11):1659–1666
Zhu ZJ, Liang F, Jiang GY, Yu M (2007) Bit allocation and rate control algorithm for stereo video coding. In: 3DTV conference, pp 7–9
Zhu C, Liu M (2009) Multiple description video coding based on hierarchical B pictures. IEEE Trans Circ Syst Video Technol 19(4):511–521
Acknowledgment
The authors would like to thank the reviewers for their constructive and valuable comments on this paper. We would also like to thank Prof. Zhenhua Ling, Dr. Haoming Chen and Dr. Chen Zhao for comments and suggestions. This research was partially supported by the Natural Science Foundation of China (No.61271324, 60932007, 61002029, 61001178, 61202266), Natural Science Foundation of Tianjin (No.12JCYBJC10400, 12JCQNJC00500, 12JCQNJC00300), and Research Fund for the Doctoral Program of Higher Education of China (No.20110032120029).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Lei, J., Feng, K., Wu, M. et al. Rate control of hierarchical B prediction structure for multi-view video coding. Multimed Tools Appl 72, 825–842 (2014). https://doi.org/10.1007/s11042-013-1386-z
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-013-1386-z