1.Department of Electronic
Information and Control Engineering, Beijing University of Technology,
Beijing 100124, China; 2.Department of Electronic
Information Engineering, The Hong Kong Polytechnic University, Hong
Kong, China;
Abstract：Multiview video involves a huge amount of data, and as such, efficiently encoding each view is a critical issue for its wider application. In this paper, a fast motion and disparity estimation algorithm is proposed, utilizing the close correlation between temporal and inter-view reference frames. First, a reliable predictor is found according to the correlation of motion and disparity vectors. Second, an iterative search process is carried out to find the optimal motion and disparity vectors. The proposed algorithm makes use of the prediction vector obtained in the previous motion estimation for the next disparity estimation and achieves both optimal motion and disparity vectors jointly. Experimental results demonstrate that the proposed algorithm can successfully save an average of 86% of computational time with a negligible quality drop when compared to the joint multiview video model (JMVM) full search algorithm. Furthermore, in comparison with the conventional simulcast coding, the proposed algorithm enhances the video quality and also greatly increases coding speed.
Smolic A, Mueller K, Stefanoski N, et al. Coding algorithms for 3DTV – a survey. IEEE Transactions on Circuits and Systems for VideoTechnology, 2007, 17(11): 1606―1621
ISO/IEC JTC1/SC29/WG11. Requirements on multi-view video coding. Document N6501, Redmond, USA, 2004
IS0/IEC JTC1/SC29/WGl1 and ITU-T SG16 Q.6. Joint Multiview Video Model (JMVM) 2.0. Document JVT-U207, Hangzhou, China, 2006
Lu J, Cai H, Lou J G, et al. An epipolar geometry-based fast disparity estimationalgorithm for multiview image and video coding. IEEE Transactions on Circuits and Systems for Video Technology, 2007, 17(6): 737―750 doi: 10.1109/TCSVT.2007.896659
Ding L F, Tsung P K, Chen W Y, et al. Fast motion estimation with inter-view motionvector prediction for stereo and multiview video coding. In: Proceedings of the International Conferenceon Acoustics, Speech and Signal Processing. Las Vegas, NV: IEEE, 2008, 1373―1376 doi: 10.1109/ICASSP.2008.4517874
Kim Y, Kim J, Sohn K, et al. Fast disparity and motion estimation for multi-viewvideo coding. IEEE transactions on consumerelectronics, 2007, 53(2): 712―719 doi: 10.1109/TCE.2007.381750
Merkle P, Smolic A, Muller K, et al. Efficient prediction structures for mMultiviewvideo coding. IEEE Transactions on Circuitsand Systems for Video Technology, 2007, 17(11): 1461―1473 doi: 10.1109/TCSVT.2007.903665
Li X M, Zhao D B, Ma S W, et al. Fast disparity and motion estimation based oncorrelations for multiview video coding. IEEE Transactions on Consumer Electronics, 2008, 54(4): 2037―2044 doi: 10.1109/TCE.2008.4711270
He Y, Ostermann J, Tanimoto M, et al. Introduction to the special section on multiviewvideo coding. IEEE transactions on Circuitsand Systems for Video Technology, 2007, 17(11): 1433―1435 doi: 10.1109/TCSVT.2007.910327
Koo H S, Jeon Y J, Jeon B M, et al. Motion information inferring scheme for multi-viewvideo coding. IEICE transactions on communications, 2008, E91-B(4): 1247―1250
ISO/IEC JTC1/SC29/WG11. Joint Multiview Video Model (JMVM) 8.0. Document N 9762, France, 2008
ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6. Common test conditions for multiview video coding. Document JVT-T207, Klagenfurt, Austria, 2006
ISO/IEC JTC1/SG29/WG11. Multiview video test sequences from MERL. Document MPEG2005/M12077, Busan, Korea, 2005
Lai P, Ortega, A. Predictive fast motion/disparitysearch for multiview video coding. In: Proceedings of SPIE Visual Communications and Image Processing. 2006, 6077
