【作者】 王宝亮；

【导师】 侯春萍；

【作者基本信息】 天津大学 ， 通信与信息系统， 2010， 博士

【摘要】 多视点立体视频的技术发展与图像获取、压缩编码、网络传输及立体显示等关键技术的发展密不可分。多视点立体视频本身具有合成困难、数据量大、难于存储和传输的特点,由这些特点引起的多视点立体视频预处理、压缩、传输等问题一直未得到妥善解决,这些问题是多视点立体视频产业化、实用化的主要瓶颈。本文通过对基于多视点的立体视频原理的深入研究,给出了一个基于H.264的多视点立体视频处理系统的整体解决方案并对其中的压缩编码、网络传输、立体显示等关键的技术进行了研究与实现。首先,本文提出了一套基于H.264的多视点立体视频的编码、传输、显示系统框架。在此框架上对所提出的的算法、协议进行了实现与验证。其次,基于JMVC测试模型,把2D视频压缩的搜索算法S-UMHexagon Search应用到了3D视频的压缩编码中,并对此算法进行了优化,从而大大提高了帧间预测时的运动搜索速率;此外,还在模式选择部分采用了快速模式选择,提前判断最优模式,降低了编码复杂度,大幅度提高了编码速率。通过以上的优化改进,压缩编码的时间降为原来的30%左右。然后,本文首次提出了基于H.264的多视点立体视频的传输协议:多视点数据管道协议(MVDC:Multi-View Data Conduit),并对协议进行了设计与实现。实际的网络传输表明,本文所提出的协议能够实现对多视点视频数据的实时、可靠传输,并能够较好的实现多视点视频数据的同步。最后,基于国家科技重大专项新一代宽带无线移动通信网―终端共性技术开放式研究(多视点自由立体移动终端显示)‖项目研制的立体显示终端,提出了小尺寸屏幕上的立体视频合成算法,设计了基于H.264的8视点立体视频的播放器,在Windows Mobile的无线环境和PC上设计并实现了多视点立体视频的播放。利用立体视频播放器,用户可以在具有立体显示屏幕的手机和PC上方便地观看到多视点立体视频。更多还原

【Abstract】 The Multi-view stereo video technology has developed to a new level with the development of the stereo video capture technologies, efficient multi-view compression algorithms, increasing bandwidth of communication links and three-dimensional video display techniques. However,multi-view stereo video has some new characteristics, such as hard to synthesize, massive volumes of data, difficult to store and transmit. These new characteristics cause problems in pre-processing, compression and transmission of multi-view stereo video, and these problems have not yet been well-solved and blocked the industrialization of multi-view stereo video technology. Based on the deep research on the multi-view stereo video technology, this paper envisages a scenario of stereo video application,put forward an overall solution of multi-view stereo video processing system based on H.264 and implement some key technologies such as compression algorithms, network transmission, 3D display.Firstly, the system of multi-view stereo video transmission and display based on H.264 is proposed, and all the algorithms and protocols are verified on this system.Secondly, based on the JMVC test model, this paper apply 2D video compression algorithm - the S-UMHexagon Search in 3D video for compressing and encoding. This paper also optimizes the multi-view stereo video coding algorithm. By this way, the speed of motion search is increasedgreatly; the coding efficiency is improved significantly by decreasing the coding complexity and determining the optimal mode in advance. As the result, the encoding time is about 30 percent of the original.Thirdly, this paper put forward a transmission protocol for multi-view stereo video transmitting over IP network for the first time, so called Multi-View Data Conduit protocol (MVDC) which is an efficient network transmission technology for stereoscopic video. After the implementation of MVDC protocol and experimental results are analyzed and verified,this protocol can achieve real-time and reliable transmission of multi-view video data,and synchronization of multi-view video data at the same time. Finally, based on the National major sicence and technology project, 8-view stereo video player on small-size screen is achieved for the first time, and display of the multi-view stereo video based on Windows Mobile’s wireless platform has also been implemented. Through the multi-view stereo video player on Windows Mobile’s wireless platform, users can easily watch the stereo video on the three-dimensional screen.更多还原