【作者】 李郝；

【导师】 董秀成；

【作者基本信息】 西华大学 ， 控制理论与控制工程， 2010， 硕士

【摘要】 计算机视觉作为一个极具挑战性的领域,一直以来都因为其巨大的发展潜力吸引了众多研究者的深入探索和研究。随着计算机性能的不断提高和电子产品的的普及,越来越多的研究人员致力于计算机视觉领域的重要研究方向人眼检测。利用人眼跟踪及人眼的视线检测,可以实现疲劳检测,残疾人交互,视觉游戏等应用。本文主要研究内容可以分为人眼检测,人眼跟踪和视线检测三个部分,在对相关算法作深入研究的基础上,采用了适合视频图像的人眼检测和实用的视线跟踪方法,并在VC平台上建立了一个人眼视线跟踪系统。首先,采用了Adaboost人脸检测算法进行人脸检测,并提出了解决平面和深度旋转的人脸的检测算法,能准确实时的检测人脸。本文在人脸检测的基础上,又设计了一些适合于眼睛的矩形特征,利用这些矩形特征训练了Adaboost层叠分类器,用于眼睛检测。由于瞳孔区域是人眼截图中比较稳定的图像信息,在睁眼的时候这部分的特征明显,因此本文采用先定位瞳孔,进而训练眨眼分类器进行眼睛的眨眼状态检测,同时,还精确的检测眼角点,为视线跟踪打下基础。其次,眼睛的位置确定后可以在此基础上进行人眼跟踪,本文提出了将卡尔曼滤波器引入粒子滤波器中,利用卡尔曼滤波器算法进行采样预测和校正,减少了人眼跟踪中所需的粒子数目,从而达到快速而准确的跟踪目的。再次,在视线跟踪系统中,该方法中以动点和参考点的差值来计算人眼的注视方向和位置。动点采用瞳孔中心,因为它可以准确反映眼球的变化。参考点采用眼角点,因为眼角点在人脸上是个非常稳定的点,人脸表情的变化基本上不会引起它的位置变化。该方法克服了过去以mark点或普尔钦斑点为参考点的缺点,不需要使用者在脸上做mark点,而且允许人脸在小范围内偏转。实验证明,该方法中自动定位眼角点快速准确,可以很好地解决视线跟踪系统中眼睛相对运动距离的问题。本文开发的人眼跟踪及人机交互系统,实现了实时人眼检测跟踪和视线检测,并且利用检测到的有意识眨眼信息进行人机交互。本系统对硬件没有过高要求,对一定的光照变化,大幅度侧脸和俯仰变化都具有很好的鲁棒性。该系统的原理与目前主流的视线检测原理不同,具有低成本高效率的特点。更多还原

【Abstract】 Computer vision as such a challenging field has enormous development potential. It has been attracting many researchers who explore and do intensive study on it. With the development of computer performance and popularity of electronic product, more and more researchers work at the human eye detection which is the important research interest in the fields of computer vision. Eye detection and eye tracking technologies can be used for fatigue detection, human-machine interaction for the disabled, visual game and so on.The main research content of this paper is divided into three parts, including eye detection,eye tracking and gaze detection,An appropriate method of eye detection for video image and a practical gaze tracking method are used based on the intensive research of related algorithm. And a real-time eye tracking and gaze detection system is constructed in VC.First, Adaboost face detection algorithm is used to detect face, at the same time, an effective paradigm to cope with big view angle and planar rotated face is proposed. Finally, the face and eyes are detected accurately and in real-time. On the basis of face detection, this paper finds some rectangular features that is suitable with eyes, and with these features the Adaboost cascade classifiers are trained for eye detection.Because the region of the pupil is relatively stable in the eye screenshot image and the pupil’s feature are obvious, so this paper locates the pupil firstly, then, eye blink classifier is trained to detect the blink status of the eyes, at the same time, eye corner is detected accuratly , this is the foundation for gaze tracking.Second, we can track eyes after finding eyes, the paper brings a Kalman filter into the particle filter, which is used to predict and revise in the sampling stage. This method can reduce the number of particles needed in tracking, and realize the purpose that tracks eyes quickly and exactly.Finally, this paper proposes a novel method for computing the eye-gaze direction and position in the eye-gaze tracking system. The eye corner is applied as the reference point instead of mark and Purkinje points in traditional ones. The difference of the moving point and the reference one is employed to compute the eye-gaze direction and position in the presented method. The center of iris is explored as the moving point due to that it can accurately reflect the moving state of eye. The eye corner is exploited as the reference point due to that it is the most stable point and relatively insensitive to facial expressions. The proposed method overcomes the shortcomings of conventional ones that adopt the mark and Purkinje as the reference points, and it does not need users to mark the marks on faces and allow the moderate variations of hear pose. Experimental results indicate that the method of the eye corner locating is fast and precise. In this way, the relative distance problem of eye motion arising in the eye-gaze tracking system can be well handled.The eye tracking and human-machine interaction system of this paper achieves the real-time eye detection and gaze tracking. And with the information of intentional blink we achieve the human-machine interaction. The system has good robustness to a certain illumination change, light side face and head tilt, but it needn’t high-level hardware condition. The method of the system is different from current dominant principle. It has a quality with low cost and high efficiency.更多还原