Please wait a minute...
Front. Inform. Technol. Electron. Eng.  2011, Vol. 12 Issue (5): 351-361    DOI: 10.1631/jzus.C1000208
    
A hybrid brain-computer interface control strategy in a virtual environment
Yu Su1,2, Yu Qi1,2, Jian-xun Luo1,2, Bian Wu1,3,4, Fan Yang1,2, Yi Li1,2, Yue-ting Zhuang1,2, Xiao-xiang Zheng1,3,4, Wei-dong Chen*,1,2
1 Qiushi Academy for Advanced Studies, Zhejiang University, Hangzhou 310027, China 2 School of Computer Science and Technology, Zhejiang University, Hangzhou 310027, China 3 Department of Biomedical Engineering, Zhejiang University, Hangzhou 310027, China 4 Key Laboratory of Biomedical Engineering of the Ministry of Education, Hangzhou 310027, China
Download:   PDF(994KB)
Export: BibTeX | EndNote (RIS)      

Abstract  This paper presents a hybrid brain-computer interface (BCI) control strategy, the goal of which is to expand control functions of a conventional motor imagery or a P300 potential based BCI in a virtual environment. The hybrid control strategy utilizes P300 potential to control virtual devices and motor imagery related sensorimotor rhythms to navigate in the virtual world. The two electroencephalography (EEG) patterns serve as source signals for different control functions in their corresponding system states, and state switch is achieved in a sequential manner. In the current system, imagination of left/right hand movement was translated into turning left/right in the virtual apartment continuously, while P300 potentials were mapped to discrete virtual device control commands using a five-oddball paradigm. The combination of motor imagery and P300 patterns in one BCI system for virtual environment control was tested and the results were compared with those of a single motor imagery or P300-based BCI. Subjects obtained similar performances in the hybrid and single control tasks, which indicates the hybrid control strategy works well in the virtual environment.

Key wordsHybrid brain-computer interface (BCI) control strategy      P300 potential      Sensorimotor rhythms      Virtual environment     
Received: 18 June 2010      Published: 09 May 2011
CLC:  TP399  
  R318  
Cite this article:

Yu Su, Yu Qi, Jian-xun Luo, Bian Wu, Fan Yang, Yi Li, Yue-ting Zhuang, Xiao-xiang Zheng, Wei-dong Chen. A hybrid brain-computer interface control strategy in a virtual environment. Front. Inform. Technol. Electron. Eng., 2011, 12(5): 351-361.

URL:

http://www.zjujournals.com/xueshu/fitee/10.1631/jzus.C1000208     OR     http://www.zjujournals.com/xueshu/fitee/Y2011/V12/I5/351


A hybrid brain-computer interface control strategy in a virtual environment

This paper presents a hybrid brain-computer interface (BCI) control strategy, the goal of which is to expand control functions of a conventional motor imagery or a P300 potential based BCI in a virtual environment. The hybrid control strategy utilizes P300 potential to control virtual devices and motor imagery related sensorimotor rhythms to navigate in the virtual world. The two electroencephalography (EEG) patterns serve as source signals for different control functions in their corresponding system states, and state switch is achieved in a sequential manner. In the current system, imagination of left/right hand movement was translated into turning left/right in the virtual apartment continuously, while P300 potentials were mapped to discrete virtual device control commands using a five-oddball paradigm. The combination of motor imagery and P300 patterns in one BCI system for virtual environment control was tested and the results were compared with those of a single motor imagery or P300-based BCI. Subjects obtained similar performances in the hybrid and single control tasks, which indicates the hybrid control strategy works well in the virtual environment.

关键词: Hybrid brain-computer interface (BCI) control strategy,  P300 potential,  Sensorimotor rhythms,  Virtual environment 
[1] J. A. Rincon, J. Bajo, A. Fernandez, V. Julian, C. Carrascosa. Using emotions for the development of human-agent societies[J]. Front. Inform. Technol. Electron. Eng., 2016, 17(4): 325-337.