运用三维音效的多目标告警系统研究

【作者】 李晓东；

【导师】 陈文宇；

【作者基本信息】 电子科技大学 ， 软件工程， 2007， 硕士

【摘要】 近年来,随着计算机、多媒体、信息处理技术等的快速发展,视频与音频信息的应用都取得了长足的进步。除了可视信息外,充分地利用语音与丰富的音频表达信息一直是研究的热点课题。用3D音效模拟音源的位置与运动的技术,是物理运动学、物理声学、人的生理声学、心理声学等的研究成果与现代数字信号处理、多媒体等技术结合的结果,是一种虚拟实现技术。三维音效模拟作为人-机-环境的多维信息交互技术,近些年来,已逐步应用到多媒体与虚拟现实系统中,进入到各种计算机游戏、科学研究,以及各种消费电子领域。多维信息交互能提高信息传递效率,将会是一个必然的发展方向。在国防应用中,很多国家的军队采用模拟器和真实装备结合训练士兵。对飞机驾驶员的目标告警,可以通过模拟器可以虚拟听觉场景,为飞行员提供敌方目标的距离、运动特性、方位等信息,起到辅助导航与告警的作用,减轻了飞行员仅依靠视觉获取信息的压力。本文以飞机驾驶员的目标告警作为潜在的应用背景,研究了音频定位的理论、HRTF(头部相关传递函数)技术及其实验数据库;分析了头相关传输函数HRTF或头相关脉冲响应HRIR的特性;探讨了多种基本音源信号应用效果。HRTF数据是因人而异的“个人数据",不同试验者的HRTF数据具有差异,如果将某个试验者的数据应用于其他试验者,HRTF定位效果将会下降,针对这种情况,还进行了HRTF的个性化的技术研究,获得了一些有益的改进措施。为了多目标告警的模拟需要,讨论了多音频叠加的实施方法,提出了一种多目标的告警机制,以及合理、有效地融合多个目标的各种主要信息的合成方案;该方案可以充分利用3D音效技术特性,综合传递目标的主要特征信息。最后,本论文基于CIPIC实验室测量的HRTF数据库,设计并搭建了多目标的3D音效告警实验系统。为了方便实验需要,系统还包括空中目标简单模拟单元,用于实时提供目标幅度、方位等参数,以及多目标信息汇集与分析单元。通过仿真实验与感知测试,验证了技术与提出方案的可行性。更多还原

【Abstract】 With the rapid development of computer, multimedia and information processing technology, video and audio information applications are making great progress. Besides the visible information, speech and rich audio expression is the hot research topic for long. Simulation of audio location and movement with 3D effect is a virtual reality (VR) technique, which is based on the kinematics, acoustics, physiological and psychological acoustics, modern digital signal processing and multimedia technology.As the interactive technology on multi-dimensional information for man-machine–environment, 3D audio effect is gradually applied in various multimedia systems and VR systems, which are found in the fields of computer games, scientific researches and entertainment. Interaction on multi-dimensional information increases the efficiency of the communication and will be a direction of future development. In defense application, many nations and armies train their soldiers with both simulator and real equipments. Simulation of audible scene could be used as an auxiliary measurement of navigation and alarming, instead of visible approach, which helps pilots on obtaining targets’distances, movements, locations and etc.With the target alarming for pilots as the potential background of this thesis, audible location theory, HRTF (Head related transfer function) and its experiment database have been researched. Analysis on characteristics of HRTF and HRIR, exploration on the effects of multiple audio elements are carried out. With the nature of personal data, HRTF is different among peoples. When an unmatched data used as the HRTF, the location results will decrease. Research on this problem is also done and improvement is obtained.For alarming of multiple targets, supposition of multi-sound is discussed in the thesis. An alarming scheme for multiple targets is also proposed to effectively integrate various information for using in the 3D sounds.Finally, based on the CIPIC’s test HRTF database, an experimental 3D-sound alarming system for multiple targets is designed and installed. The system includes a simple target simulation unit to provide the amplitude, location and other target parameters, and a collection and analysis unit for multiple targets’parameters. Experiments and perceptive tests of the system verified the techniques and schemes proposed in the thesis.更多还原