节点文献

自然三维电视系统中的深度提取技术研究

Research on Depth Extraction of Natural Three-dimensional Television System

【作者】 谢贤海

【导师】 张明; 李东晓;

【作者基本信息】 浙江大学 , 信息与通信系统, 2010, 硕士

【摘要】 电视技术经过黑白电视、彩色电视和数字高清晰度电视三个阶段,逐渐向着大屏幕、彩色化、高清晰度、多媒体方向发展,而三维电视(3DTV)具有深度感和临场感,因而必将成为下一个新的发展方向,因此研究高效的三维电视系统具有很大的现实意义。论文一方面围绕3DTV的研究现状,提出一种新的3DTV系统架构方式——自然三维电视系统。该系统强调的是自然的场景和自然的无需佩戴眼镜式的立体感受,采用的编码结构是当前比较实用的“一路视频+深度”的方式,同时引入了“遮挡信息”,在保证清晰的主视点立体显示效果的同时,提供了丰富的侧向和遮挡信息;同时该系统具有良好的可伸缩性,通过配置摄像头数量及遮挡信息的丰富程度,控制传输带宽和存储代价,获得不同质量的三维效果。另一方面在3DTV系统的关键难题——深度提取算法这块做了大量工作。研究了立体匹配算法的研究现状和算法原理,在编写了立体匹配算法的系统框架调试软件的同时实现了多种深度提取算法。最后,论文在现有深度提取算法各自独立的启发下,分析了立体匹配多种算法结合的可能性,并提出一种并行优化模型,适用于任意两种深度生成算法的优化。具体来说,该模型包括以下4个步骤:1)可靠像素点判定;2)可靠视差层选择;3)基于CROSS聚合的非可靠区域的视差填充;4)基于Canny边界检测的轮廓拟合。实验结果显示,该优化模型能充分发挥两种算法的优点,适用于任意两种深度提取算法的优化。并且非常高效,耗时不到1s,因此,这也可以作为两种实时算法的后期优化方案。

【Abstract】 With the development of television(TV) which from black and white TV, color TV to digital high-definition TV, the TV technology has gradually towards the direction of large-screen, color, high-definition and multimedia. The three-dimensional television (3DTV) has a depth and ambiance sense, so it will surely to be the next direction of TV. It has a great practical significance to research the 3DTV system.Around the status of 3DTV research, the paper propose a new 3DTV system - a natural three-dimensional television system. The system is stressed that the natural scene and natural 3D feeling without wearing glasses, and using the currently practical coding structure of "one video + depth" approach, while introduced the concept of "occlusion information". With the "occlusion information", not only do the audiences have the clear 3D display of main view, but also providing a rich side and occlusion information. Additional, this system has good scalability, which can obtain the different quality of 3D effect by configuring the camera, blocking information and control bandwidth and storage costs.Then, I have done a lot of work in the key challenges of depth extracting of the natural 3DTV system. After researching the status and theory of stereo matching algorithm, I programmed a experimental platform software for stereo matching algorithms and achieved a wide range of stereo matching algorithm.Finally, Inspired by the defects of single stereo matching algorithm, I propose a novel parallel optimization model for two arbitrary stereo matching algorithms. It includes four steps: Firstly, reliable disparity pixel marking; Secondly, reliable disparity layer selecting; And then, unreliable region filling based on cross aggregation; Finally, border handling based on canny edge detection. The experimental results show that the model can make full use of the advantages of two methods, especially for both poor methods. Additionally, our model is very efficient and it takes less than one second for a typical image. Therefore, it can be used as an optimization model for both real-time stereo parallel algorithms.

  • 【网络出版投稿人】 浙江大学
  • 【网络出版年期】2010年 08期
节点文献中: 

本文链接的文献网络图示:

本文的引文网络