【作者】 钱涛；

【导师】 王轩；

【作者基本信息】 哈尔滨工业大学 ， 计算机科学与技术， 2010， 硕士

【摘要】 手语是一种动作语言,通过一连串手势的运动并附以适当的面部表情或身体躯干姿势来表达语意,是聋哑人的第一自然语言。目前中国标准手语的推广程度不高,内部仍存在着地域差异和社会差异。所以,建立中国手语标准词库,将信息通过标准手语表达出来,消除沟通障碍,帮助聋哑人更好的融入信息化社会,已成为当前亟待解决的一个问题。本文通过对中国手语的研究,基于虚拟人技术,运用运动捕捉、运动编辑、运动控制和运动合成技术,实现了一个手语库构建系统,并使用该系统采集了《中国手语》中收录的全部5586个手语词。本文首先综述了目前国内外手语研究的成果及现状,并分析了传统的基于硬件采集和软件设计这两种手势生成方法的优缺点,然后结合两种方法的优点,实现了一种构建三维数字化标准中国手语库的方法。在该方法中,首先应用两只基于角度传感器的数据手套和8个光学摄像头,基于运动跟踪的原理,采集每个手语词的运动数据,建立一个初始的手语词运动数据库;然后,应用一种基于控制点的人体运动编辑方法,对每个手语词的运动数据进行编辑,最后得到一个高质量的三维数字化标准中国手语库。本文还实现了手语合成系统,它可将输入的汉语文本翻译成手语,提取手语库中对应的数据,经过虚拟人运动合成模块处理后以VRML的格式输出为手语动画。实现结果显示,经由上述方法生成的手语词库所占存储空间小,合成手语动画标准、逼真,动作自然,可以达到正常交流的目的。更多还原

【Abstract】 Sign language is the first nature language of deaf, that express meaning through the hands’movement with appropriate expressions or gestures. The promotion of Chinese version sign language is not enough. There still exist regional differences and social differences between different sign languages. Therefore, building a Chinese sign language standard dictionary, to express information through the standard sign language, to eliminate communication barriers, to help the deaf to integrate into the information society better, is of great significance.This paper presents a 3Ds digital standard Chinese sign language database construction system, based on the study of Chinese sign language, the technique of virtual human , motion capture, motion editing, motion control and motion synthesis, and collected all the 5586 sign language word contains in the book "Chinese Sign Language".This paper first analysis both the advantages and disadvantages of two traditional method of Gesture generation, the hardware-based and the software-based, and then combining the advantages of both methods to achieve a 3D digital database construction for standard Chinese sign language. First in this method, apply two data glove, and eight optical cameras, using the principle of motion capture to collect movement data of each sign language word, and create an initial sign language database. Second, apply control point-based human motion editing method for the data of each sign language word, and get a high quality 3D digital database of standard Chinese sign language.This paper also achieved a sign language synthesis system, which can translate Chinese text into sign language, use corresponding data in the sign language database,and output sign language animation in VRML through the virtual human motion synthesis module.The results show that storage space of the sign language database generated by this method is small, the animation of sign language is standard, realistic, and natural, can achieve the normal communication purposes.更多还原