Please wait a minute...
Front. Inform. Technol. Electron. Eng.  2014, Vol. 15 Issue (10): 832-838    DOI: 10.1631/jzus.C1400150
    
Coordinated control of an intelligent wheelchair based on a brain-computer interface and speech recognition
Hong-tao Wang, Yuan-qing Li, Tian-you Yu
School of Information Engineering, Wuyi University, Jiangmen 529020, China; School of Automation Science and Engineering, South China University of Technology, Guangzhou 510640, China; Engineering Research Center for Massive Biometric Information Processing, Jiangmen 529020, China
Download:   PDF(0KB)
Export: BibTeX | EndNote (RIS)      

Abstract  An intelligent wheelchair is devised, which is controlled by a coordinated mechanism based on a brain-computer interface (BCI) and speech recognition. By performing appropriate activities, users can navigate the wheelchair with four steering behaviors (start, stop, turn left, and turn right). Five healthy subjects participated in an indoor experiment. The results demonstrate the efficiency of the coordinated control mechanism with satisfactory path and time optimality ratios, and show that speech recognition is a fast and accurate supplement for BCI-based control systems. The proposed intelligent wheelchair is especially suitable for patients suffering from paralysis (especially those with aphasia) who can learn to pronounce only a single sound (e.g., ‘ah’).

Key wordsBrain-computer interface      Speech recognition      Coordinated control      Intelligent wheelchair     
Received: 26 April 2014      Published: 09 October 2014
CLC:  TP399  
  R318  
Cite this article:

Hong-tao Wang, Yuan-qing Li, Tian-you Yu. Coordinated control of an intelligent wheelchair based on a brain-computer interface and speech recognition. Front. Inform. Technol. Electron. Eng., 2014, 15(10): 832-838.

URL:

http://www.zjujournals.com/xueshu/fitee/10.1631/jzus.C1400150     OR     http://www.zjujournals.com/xueshu/fitee/Y2014/V15/I10/832


基于脑机接口与语音协同控制的智能轮椅

研究目的:面向重症瘫痪(特别是伴随失语症)病人,充分发掘其有限对外交流信息的途径(脑电、语音等),利用脑机接口与语音识别协同控制的方式实现智能轮椅控制。
\n创新要点:采用脑电(事件关联电位、运动想象)和语音(单音,如\"啊\")实现了轮椅的前进、左转、右转和停止功能。
\n研究方法:设计了轮椅控制硬件平台(图1)和协同控制算法(图4)。其中,事件关联电位脑机接口(P300)子算法识别受试者是否注视\"S\"闪烁键(闪烁键界面如图3所示),若受试者有控制意图,则转化成相应的启动指令;运动想象脑机接口子算法实时提取受试者脑电信号,并将其左/右手运动想象意图转化为左/右转控制指令;语音识别子算法识别受试者主动发出的单音(如\"啊\"),并转化为停止指令。
\n重要结论:受试者仅用视觉刺激,想象左/右手及单音(如\"啊\")就能控制轮椅的前进、左转、右转、停止和启动。五位健康受试者参与了评估实验,达到了良好的控制效果,特别是最佳时间比和最佳路径比两项指标令人满意。

关键词: 脑机接口,  语音识别,  协同控制,  智能轮椅 
[1] Bang-hua Yang, Liang-fei He, Lin Lin, Qian Wang. Fast removal of ocular artifacts from electroencephalogram signals using spatial constraint independent component analysis based recursive least squares in brain-computer interface[J]. Front. Inform. Technol. Electron. Eng., 2015, 16(6): 486-496.
[2] Zhi-qiang Song, Hua-xiong Li, Chun-lin Chen, Xian-zhong Zhou, Feng Xu. Coordinated standoff tracking of moving targets using differential geometry[J]. Front. Inform. Technol. Electron. Eng., 2014, 15(4): 284-292.
[3] Yu Qi, Fei-qiang Ma, Ting-ting Ge, Yue-ming Wang, Jun-ming Zhu, Jian-min Zhang, Xiao-xiang Zheng, Zhao-hui Wu. A bidirectional brain-computer interface for effective epilepsy control[J]. Front. Inform. Technol. Electron. Eng., 2014, 15(10): 839-847.
[4] Jin-he Shi, Ji-zhong Shen, Yu Ji, Feng-lei Du. A submatrix-based P300 brain-computer interface stimulus presentation paradigm[J]. Front. Inform. Technol. Electron. Eng., 2012, 13(6): 452-459.
[5] Yu Su, Yu Qi, Jian-xun Luo, Bian Wu, Fan Yang, Yi Li, Yue-ting Zhuang, Xiao-xiang Zheng, Wei-dong Chen. A hybrid brain-computer interface control strategy in a virtual environment[J]. Front. Inform. Technol. Electron. Eng., 2011, 12(5): 351-361.
[6] Hai-hua Xu, Jie Zhu. An iterative approach to Bayes risk decoding and system combination[J]. Front. Inform. Technol. Electron. Eng., 2011, 12(3): 204-212.
[7] Wei-dong Chen, Jian-hui Zhang, Ji-cai Zhang, Yi Li, Yu Qi, Yu Su, Bian Wu, Shao-min Zhang, Jian-hua Dai, Xiao-xiang Zheng, Dong-rong Xu. A P300 based online brain-computer interface system for virtual hand control[J]. Front. Inform. Technol. Electron. Eng., 2010, 11(8): 587-597.