节点文献
基于想象左右手运动思维脑电BCI实验及识别分类研究
Recognition Classification and BCI Experiments for Mental EEG of Imaging Left-right Hands Movement
【作者】 伍亚舟;
【导师】 吴宝明;
【作者基本信息】 第三军医大学 , 生物医学工程, 2007, 博士
【摘要】 背景近几年来,利用不同思维作业脑电信号作为实现脑-机接口(BCI)的一种新型人机接口技术,已受到了广泛的关注。BCI是在人脑和计算机或其它电子设备之间建立的一种直接的信息交流和控制通道,它是不依赖于脑的正常输出通路(外周神经系统及肌肉组织)的全新的信息交流系统。它的一个最重要用途是为那些思维正常但有严重运动障碍的患者提供语言交流和环境控制途径,以提高其生存质量;另外,BCI技术在特殊作业和军事环境等领域也有潜在的应用价值,还可以作为一种新的信息交流控制手段和娱乐方式。BCI正成为脑科学、康复工程、生物医学工程及人机自动控制研究领域的一个研究热点。目前,BCI的研究正处于探索阶段,现有BCI系统的识别正确率和识别速率、性能稳定性等关键技术还需要解决。BCI系统本质上就是识别特定的脑电模式,然后按照预设规则将获取的脑电转化为外部信息。实际应用中,实验设计、信号获取、算法选择(特征提取、特征分类)等因素都会影响最后的结果。因此,BCI系统全面建立过程中,实验设计和信号获取是非常重要的第一步,也是获得良好结果的前提。目前,获取脑电的方式主要是非侵入式方法,它有3种类型:①在思维作业期间,不进行任何刺激情况下,通过头皮电极记录脑电;②利用单次视觉诱发脑电获得脑电;③在感觉运动皮层区,利用μ节律的同步化和去同步化获得脑电。本文主要采用第一种方式获取BCI的控制信号,即通过想象左右手运动获取思维脑电。本文开展了基于想象左右手运动思维脑电信号的BCI系统控制信号采集、特征提取与识别分类研究。本研究目的是探索一种实用的基于想象运动思维脑电的BCI方式,通过寻找合适的信号处理方法,来提取最能反映不同思维的脑电特征,以得到准确的BCI系统外部控制命令,从而提高BCI系统通讯的识别正确率,为最终实现BCI应用奠定比较坚实的理论和实验基础。方法基于人在不同思维时表现的基本特性,本文阐述了基于想象左右手运动思维脑电信号用于BCI的原理。利用双计算机和Active One(生理信号测量系统)建立了一个基于想象左右手运动思维脑电的BCI信号采集实验系统。本研究采用头皮电极记录大脑皮层的自发脑电,该记录方式无创,使用者无需训练。通过软件编程的方式产生实验提示控制模式,屏幕上随机地出现向左或向右的箭头,受试者作出相应的选择,从而进行按键。对6名健康受试者进行3种不同时段(箭头出现2s、1s和0s后提示按键)情况下想象左右手运动思维作业的信号采集实验。随后,对实验数据进行离线处理和分析:通过对几种思维脑电信号处理方法的比较研究,提出利用小波多分辨率结合统计特性分析方法提取反映不同思维作业的脑电特征,同时研究了几种可用于本研究信号提取的基本小波函数;在对信号的模式识别方法进行比较深入而系统地研究基础上,提出了利用前向反馈神经网络(BP神经网络)方法识别分类这些特征。结果对所有受试者三种情况下平均延缓时间Δt2、Δt1和Δt0分析发现,Δt0与Δt1和Δt2之间均存在显著性差别(p<0.05),而Δt1与Δt2之间没有显著差别(p>0.05);三种情况下(特别在t=1s时),实际按键前大概0.51s左右,想象左右手运动的思维脑电特征信号发生了明显改变,且这些特征存在明显不同。本研究得到的识别分类结果:在三种不同时段情况下,当训练集和测试集为同一受试者时(即同一受试者的部分样本作为训练集,其他部分样本作为测试集),比如待识别分类的特征向量集为C3通道,三种情况下测试集的平均分类正确率分别达到65.00%、86.67%和72.00%,最大为90.00%,这些结果表明对于同一受试者而言可以获得比较理想的分类效果。不过,训练集和测试集为不同受试者时(即某个受试者作为训练样本集,其他受试者为测试样本集),对其他受试者测试的识别分类正确率的平均值仅为60.00%左右,该结果表明:不同个体之间存在一些差异。在同一时段情况下(如箭头出现t=1s后提示按键),当特征向量集分别选择C3、C4、CZ和这三个电极合并时,其识别分类正确率分别为86.67%、76.67%、70.00%和65.00%。该结果表明,特征向量选择单独某个电极比这些电极合并时得到的分类率要高些。结论本文设计三种情况下获取BCI信号的实验方案是可行的;本研究提出的在小波变换域中提取特征的方法可以有效地实现信号的去噪、降维和特征提取,是一种十分有效的特征提取方法;采用基于前向反馈神经网络(BP神经网络)的识别分类方法来识别想象左右手运动思维脑电特征,可以得到比较理想分类正确率和BCI系统外部控制信号,是一种有效的且易实现的信号识别方法。在选择合适通道构建特征向量集基础上,箭头出现1s后提示按键(随机按键)这种情况,可以获得更高的识别分类正确率。这说明通过合理实验设计获取的信号有助于识别正确率的提高;本研究提出的特征作为BCI系统外部装置控制信号是可行的,为BCI系统中不同思维任务的特征提取与识别分类提供了一种新的思路和方法。
【Abstract】 Background Recent years, a novel kind of human-computer interface technology using EEG signal of different mental tasks as to achieve Brain-computer interface (BCI) has been explored widely. BCI is a direct and fire-new system of information exchange and control channels between brain and computer or other electronic equipment, which do not depend on the brain’s normal output channels (peripheral nerves and muscles). One of the most important purposes for the BCI comes mainly from the hope that the system can provide language communication and environmental control for those with severe motor disabilities but normal thoughts, and improve the quality of their lives. What’s more, the BCI technology has possible applications in other fields, such as special workover and military affairs, and it will be a new way for exchange or control of information and entertainment. BCI research has drawn attention of scientists in brain-science research, rehabilitation engineering, and biomedical engineering or human machine automatic control. Currently, the BCI technology is still under development. The key point technique need to be solved for the current BCI,such as correct rate and speed of recognition, stability of performance, et al.BCI essentially recognize the specific pattern of EEG, and translate the EEG into the external information according to the regulation in advance. In practical application, it is very important that we decide to carry out the experimental design, the acquisition of signal (collection of datum) and the arithmetic selection (feature extraction and classification of EEG signal), which also affect the final results. Therefore, the design of experiment and the acquisition of signal are the first step in the establishment of entire BCI and the premise of getting the good result. At present, non-invasive way is the primary way for the acquisition of EEG, which have three types:①EEG was recorded by the scalp electrode under the condition of no stimulation during the mental tasks;②EEG was gotten by the single visual evoked potential stimulus;③EEG was obtained by Event-Related Desynchronizations and Event-Related Synchronization ofμrhythm in the region of sensorimotor cortex. The first type of recording method was taken in our study to acquire the control signal for BCI’s construction, that is, EEG of mental tasks was obtained under the thoughts activity of imaging left-right hands movement.In present research, collection, feature extraction and recognization classification of control signal based on EEG under the imaging left-right hands movement have been carried out for the study on BCI system construction. The purpose of our study is to explore a practical way of BCI based on mental EEG by imagining movement, find a suitable method of signal processing to extract different EEG feature, which can get precise external control command of BCI system, accordingly, to enhance the correct rate of recognition for BCI system, all of which establish a substantial theory and experiment foundation for the final application of BCI.Methods The principle of BCI construction based on the mental EEG under the thoughts activity of imaging left-right hands movement was explained according to the basic features in the different thoughts. The experimental system of signal collection for BCI based on mental EEG of imaging left-right hand movement was established by the utilizing double-computer and Active One (biopotential measurement system).In our study, scalp electrode was adopted to record EEG in cerebral cortex. This recording skill is no traumatic and the users don’t need to be trained. The leftward or rightward arrow occurred randomly on screen according to software programming produced the command mode of experimental cue. Then, the subjects gave a homologous selection so that they can press the key. In this paper, the different mental tasks for imaging left-right hands movement from 6 subjects were studied in the experiment of signal collection at three different time section (hint keying after arrow 2s, 1s and 0s). Then, the off-line experimental data were processed and analyzed: By studying several processing methods of mental EEG signal and comparing of each other, the extraction method of EEG features, which can reflect different mental tasks by utilizing the method of combining wavelet multitude resolution analysis with statistics characteristics analysis, was introduced. Meanwhile, several basic wavelet functions that can be used to extract signal were proposed in our study. On the base of the pattern recognition methods for signal deeply compared and systematically studied, these features were recognized and classified by using Feed-forward Back-propagation Neural Network (BP-NN). Results Average delay timeΔt2、Δt1 andΔt0 for all subjects in three different time section were analyzed, we discovered that there is significant difference (p<0.05) betweenΔt0 andΔt2 , betweenΔt0 andΔt1, but there is no significant difference (p>0.05) betweenΔt2 andΔt1. At three circumstances (at t=1s particularly), there are obviously different features for imaging left-right hands movement about 0.51s before practical movement, these features have significant difference.The main results about recognization and classification were obtained as the fellow: Under the condition of three different time section, when the train sample and test sample come from the same subject (that is, some sample of a subject are the train, the others of the subject are the test), for example, feature vectors to be recognized and classified all come from the C3 passage, the average correct rate of classification for the test sample at three conditions are 65.00%、86.67% and 72.00% respectively, the maximum is 90.00%. These results suggest that ideal classification effect relatively for the same subject were obtained. However, the train sample and the test sample come from different subjects (that is, one subject is the sample of train, the others are the sample of test), the correct rate for others subjects’the test are about 60.00%. These results indicate that there is still some difference among the subjects.Under the condition of the same time section (as hinting keying after arrow 1s), the C3、C4、CZ and the incorporation of three electrodes were selected as feature vectors, the average correct rate of classification for the test sample are 86.67%,76.67%,70.00%and 65.00% respectively. These results showed that the classification rate obtained from feature vectors selecting certain an electrode was high more than the incorporation of these electrodes.Conclusion In this paper, it was feasible to design experimental project for acquiring signals of BCI at three circumstances. The extractive method of feature vectors in the domain of wavelet transform, which can effectively remove noise, decrease dimension and extract feature of signal,was proposed and confirmed as a effective and practical technique. The ideal correct rate of classification relatively and the external control signal of BCI system were obtained through using the pattern recognition classification method based Feed-forward Back-propagation Neural Network (BP-NN) to recognize features of mental EEG for imaging left-right hands movement. It is an available method of signal pattern recognition, which is come true easily.On the base of selecting suitable passage to construct feature vectors, we got higher correct rate of recognization and classification under hinting keying after arrow about 1s. This shows it was helpful to increase the correct rate by reasonable experimental design. The feature extracting method proposed in this study has been proven feasible to be used as external control signals for BCI system. This study has provided new ideas and methods for feature extraction and classification of different mental tasks for BCI.
【Key words】 brain-computer interface (BCI); electroencephalogram; mental tasks; feature extraction; wavelet transform; BP Neural Network;