【作者】 张会兵；

【导师】 韩燮；

【作者基本信息】 中北大学 ， 计算机应用技术， 2010， 硕士

【摘要】 逼真场景的生成是虚拟现实研究的核心内容。从现有场景的几幅离散图像合成任意视点新视图,就是根据虚拟现实的应用需求而诞生的。视图合成技术研究如何使用两幅或多幅关于某个场景的图像,生成该场景在新视点下的相应图像。基于深度图像的视图合成研究的内容主要包括深度图像的获取和视图合成算法的研究。本文研究使用计算机视觉的相关算法获取图像的深度信息。主要包括相机定标、基础矩阵估计、立体匹配和深度估计等内容。本文首先研究了当前的相机定标方法,提出了改进的基于液晶显示器的相机快速定标方法。然后使用基于角点的特征匹配获得视图的稀疏匹配,通过使用改进M-Estimators方法计算得到鲁棒的基础矩阵F,再使用基于双阈值的分阶段立体匹配获取两幅视图的稠密匹配。最后通过对应点的匹配信息计算得到匹配点的三维信息。基于深度图像的视图合成是本文研究的重点。本文基于物体表面深度的连续性,利用对应共轭极线的整体匹配性和保序性,以及深度图像中隐含的基于广义视差的图像边界点信息,提出了基于逆向映射的深度图像视图合成算法。从一幅主参考源视图获取新视图对应像素的深度信息,进而通过逆向映射算法得到新视图在参考视图中的对应像素信息,从而得到新视图像素点的灰度信息,最终得到新视图。由于遮挡关系和投影区域扩张的原因导致新视图中不可避免地存在空洞。本文根据对极几何的相关知识,提出了改进的单点逆向映射空洞填补算法。使用了少量参考源视图,完成对合成的新视图中的空洞进行填补,并最终得到完整的新视图。更多还原

【Abstract】 Realistic scene generation is the core of virtual reality research. From existing pieces of discrete viewpoint image synthesis a new image, in accordance with the needs of the application of virtual reality. The view synthesis technology study how to generate a new point of view of the scene under the corresponding image, with the use of two or multiple images from a same scene.The research of depth image-based view synthesis includes the estimation of depth image and view synthesis algorithm. Among them, this study related to the use of computer vision algorithm to obtain the image depth information. The main contents include camera calibration, fundamental matrix estimation, stereo matching and depth estimation and so on. Firstly, this paper studies the current method of camera calibration and an improved fast camera calibration method based on LCD monitor was proposed. Secondly, stereo matching based on feature of the corner points was used to obtain a sparse matching, Robust Fundamental Matrix F was estimated by using the improved M-Estimators, and then dual-threshold-based phases stereo matching was used to obtain dense matching. Finally, the three-dimensional information of the corresponding point was calculated by matching point.Depth image-based view synthesis is the focus of this study. A depth image view synthesis algorithm based on Inverse Mapping was presented, which was based on the continuity of the depth on the surface, using the overall matching and order holding of the polar line, as well as the boundary point of information based on generalized disparity hided in the depth image. The depth information of corresponding pixel in new image was obtained through a primary reference source, and then the gray information of corresponding pixel in new image was obtained in the reference image by the reverse mapping algorithm, eventually a new image was obtained. As the occlusion relations and projection of regional expansion in the new view, empty inevitably exist. With the knowledge of polar line, an improved algorithm based on reverse mapping of single point was presented to fill the blank space in the new image. The blank space in the new image was filled, and a complete new image was obtained, with the use of little reference source image.更多还原