【作者】 吴嘉；

【导师】 于慧敏；

【作者基本信息】 浙江大学 ， 信息与通信工程， 2010， 硕士

【摘要】 随着信息科学与计算机技术的发展,三维信息获取技术已成为工业检测、生物医学、虚拟现实等领域的关键技术,在机械加工、影视特技制作、高级游戏、文物保护、服装设计、三维通讯、航天遥测、军事侦察等领域有广阔的应用前景。在上述领域中,人们对三维获取技术的要求也越来越高。而目前主要采用的多目立体视觉技术、结构光技术、DFM or SFM(depth from motion or struction frommotion)、DFF和TOF(Time of flight)等三维获取技术,都有各自的优点和缺点,但至今还没有一种技术能很好地满足实时性、高精度、高分辨率和低成本等要求。TOF技术是近几年来迅速发展起来的三维获取技术,其优点是精度高、实时和廉价;缺点是距离较大时会产生深度数据的不确定性,空间分辨率还较低。多目立体视觉是一种应用很广,并已被深入研究的三维获取技术,其主要缺点是立体匹配计算量大、容易产生误匹配,对于阵列摄像机系统,其实现代价非常昂贵。本论文主要研究基于阵列摄像机的深度图获取算法,用到的摄像机阵列包含一个TOF摄像机和多个可见光摄像机。算法的主要思想是根据TOF摄像机提供的低分辨率深度图,来得到每个可见光摄像机视点上的高分辨率深度图。在每个可见光摄像机视野下的深度图求取过程中只用到了该可见光摄像机本身的灰度图或者彩色图和3D摄像机的低分辨率深度图以及强度图。首先,本文提出一种新的TOF摄像机和可见光摄像机之间的标定方法,该标定方法同时用到了TOF摄像机视野下的强度图和深度图。实验证明本论文中新的标定方法在用于TOF摄像机和普通摄像机之间的标定的时候较传统的摄像机标定方法有着更高的精度。然后,本论文根据具体的应用场合的不同提出了一些不同的基于阵列摄像机的深度图获取算法。第一,针对室内简单场景,本文提出了基于误差平方最小化能量函数的实时深度信息获取算法。第二,本文提出了针对室内复杂场景的深度图获取算法,该算法用到了一种新的融合了颜色信息和深度信息的能量函数,该能量函数能够保证在对深度值进行迭代修正的时候尽量的拿到正确的数据,实验证明该算法在复杂场景下有着不错的效果。第三,对上述的复杂场景下算法进行了改进,引入了TOF深度值的不确定性描述和标定参数本身的不确定性描述,并在迭代修正过程中采用了自适应的邻域计算方法。实验证明本论文中算法能够在各自的应用场合下成功的生成摄像机阵列中各个可见光摄像机视野下高质量的高分辨率深度图。最后,对本论文中的深度信息获取算法进行了总结,并提出了未来的研究方向。更多还原

【Abstract】 With the development of information science and computer technology, three-dimensional information acquisition has become the key technology in the areas of Industrial inspection, bio-medicine, virtual reality, etc, and three-dimensional information acquisition technology has a wide application prospect in machining, film special effects production, advanced gaming, conservation, costume design, three-dimensional communication, aerospace remote sensing, military reconnaissance, and so on. In these fields, people’s requirements on three-dimensional information acquisition technology are increasingly high. Three-dimensional information acquisition technologies currently used, such as Multi-head stereo vision technology, Structured light technique, DFM or SFM(depth from motion or struction from motion)、DFF and TOF(Time of flight), have their own advantages and disadvantages, and no single technology can satisfy requirements of real-time, high accuracy, high resolution and low cost. TOF technology is developed rapidly in recent years, its advantages are high accuracy, real-time, and low-cost, the disadvantage is that long distance will cause large uncertainty in the depth data, and spatial resolution is still relatively low. Multi-Stereo vision has been deeply studied and widely used. Its main drawbacks are large amount of stereo matching calculations; easily lead to false matches; and for the camera array system, its implementation cost is very expensive.This paper mainly studies on the depth map estimation algorithms based on camera array. Camera array used in this paper consists of one TOF camera and several visual cameras. Algorithms proposed in this paper seeks to generate high resolution depth image under the view of each visual camera, in this process only each visual itself and TOF camera are used. Passive stereo is not used in our methods.Firstly, a new calibration method between visual camera and Time-of-Flight camera is proposed, in which the intensity image and depth image of TOF camera are both used. In the experimental result, we can find that our new method works better than the traditional calibration method when it is used in the calibration between TOF camera and visual camera. Then, for different applications, a number of depth map estimation algorithms based on camera array are proposed in this paper. First, for indoor simple scene, we proposed a real-time depth map estimation algorithm for visual camera. The optimal depth value is calculated by minimizing the squared error. Second, a new depth map estimation algorithms based on camera array for the indoor complex scene is proposed. In this algorithm, the new energy function fuses two different kinds of data: the depth data and the color data, and makes sure that the proper data are always chosen when we are estimating the depth data of the pixels in the refinement procedure. Third, the depth map estimation algorithm in application of indoor complex scene is improved by introducing the uncertainty of TOF depth value and calibration parameters, and adopting the adaptive neighborhood calculating method. Experimental results of all algorithms show that the high resolution depth maps under the view of visual cameras are successfully generated and of high qualityFinally, we give the summary of the algorithms in this paper and the future researchdirections.更多还原