基于多点触控的大屏幕人机交互技术研究与应用

【作者】 裘皓萍；

【导师】 冯瑞；

【作者基本信息】 复旦大学 ， 计算机软件与理论， 2011， 硕士

【摘要】 随着物联网技术的快速发展,在消防监控和交通管理等很多领域得到了广泛应用。大屏幕作为信息展示的重要设备,正起到愈来愈重要的作用。然而,由于缺乏合理有效的人机交互方式,只能实现大屏幕到用户的单向信息展示,用户无法全面地获得信息支持,直接影响用户对信息的把握与利用。如何让系统中的海量信息被用户通过自然的操控方式全方位、多维度地掌握和利用,已经成为亟待解决的问题。本文围绕物联网系统中的大屏幕人机交互技术及其实际应用,展开理论和应用研究,提出基于多点触控技术的大屏幕人机交互解决方案,实现了大屏幕信息显示与用户间的双向信息交互,具体研究内容如下：◆针对多点触控实现成本与技术成熟度的矛盾,以及多点触控在人机交互方面存在的若干问题,提出结合具有多点触控功能的智能终端,在已有的大屏幕设备上实现稳定性好,精度高,并支持多用户交互的大屏幕多点触控方案。◆结合实际应用需求,针对目前多种多样的大屏幕显示系统和智能终端开发环境,提出基于MvC模式的三层系统架构,使其具有开放性好,可扩展和低耦合性等特点,并设计分阶段的交互协议,以适应各层间的通信需求,从而满足大屏幕与智能终端的多样性需求；◆针对大屏幕与智能终端在实际应用中的不同交互场景和模式,结合多点触控人机交互的OCGM隐喻,提出多源信息的大屏幕可视化设计和智能终端交互设计,支持多点触控的多种操控方式,满足不同应用场景需求。◆结合消防信息化系统中的实际应用需求,基于本文提出的系统解决方案与人机交互方法,提出面向消防领域的多源信息展示与人机交互系统的设计方案。更多还原

【Abstract】 With rapid development of Internet of Things (IOT) and its relative technologies, it has been used in wider fields, such as in fire monitoring, traffic management and so on. Large-scale display is the important equipment to show the huge amounts of information in the IOT system to the users. Without reasonable and effective human-computer interaction (HCI), only one-way information transportation from display to users is available. It makes the displays losing real-time and flexible reaction on user’s demand and limits the fully usage of the information. Therefore, the research in HCI of large-scale displays can be great help for the promoting of IOT.This thesis studies the HCI of large-scale displays in the IOT systems and the practical application. An interaction solution based on multi-touch technique is provided. It establishes a two-way information interaction between display and users. The research objectives and main achievements in the thesis are listed as follows:◆Based on the contradiction between cost and technology maturity, this thesis presents a large-scale display interaction solution using intelligent terminal with multi-touch to achieve great stability, high precision and support multi-user. It also solves some shortages in HCI of large-scale multi-touch.◆Targeting on the practical application requirement and multiple development environments for display systems and terminals, a three-layer system architecture based on MVC model is presented. It owns expansibility and low coupling to meet the demand of diversity. With three-phase interaction protocol, terminals can collaborate with display by effective information communication.◆Aiming at different interaction scenes and models, visualization of information display and interaction of terminal are designed to be applicable to multi-touch control and massive information display.◆Combining with application requirements from fire information system, multiple source information display and interaction system is designed based on the solution, architecture and interaction of this thesis.更多还原