安兴伟,曹勇,焦学军,明东.基于视听交互刺激的认知机理与脑机接口范式研究进展[J].电子测量与仪器学报,2017,31(7):983-993
基于视听交互刺激的认知机理与脑机接口范式研究进展
Research on cognitive mechanism and brain computer interface application in visual auditory crossmodal stimuli
  
DOI:10.13382/j.jemi.2017.07.001
中文关键词:  视听交互刺激  认知心理机制  脑机接口范式
英文关键词:visual auditory crossmodal stimuli (VACS)  cognitive psychology mechanism  brain computer interface (BCI) paradigm
基金项目:国家自然科学基金(91520205, 81630051, 61603269, 81671861)、中国博士后科学基金(2017M610162)资助项目
作者单位
安兴伟 1. 天津大学生物医学工程系天津300072;2. 天津大学医学工程与转化医学研究院天津300072 
曹勇 中国航天员科研训练中心北京100092 
焦学军 中国航天员科研训练中心北京100092 
明东 1. 天津大学生物医学工程系天津300072;2. 天津大学医学工程与转化医学研究院天津300072 
AuthorInstitution
An Xingwei 1. Department of Biomedical Engineering, Tianjin University, Tianjin 300072, China; 2. Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, China; 
Cao Yong China Astronaut Research and Training Center, Beijing 100092, China 
Jiao Xuejun China Astronaut Research and Training Center, Beijing 100092, China 
Ming Dong 1. Department of Biomedical Engineering, Tianjin University, Tianjin 300072, China; 2. Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, China; 
摘要点击次数: 3772
全文下载次数: 12942
中文摘要:
      与人类视听觉感知密切相关的图像、语音和文本(语言)信息在社会经济发展与国家安全保障等领域中扮演着重要角色,脑机接口(BCI)是无需外围神经肌肉便可操控外部设备、使“思想”直接变成“行动”的创新技术,基于视、听觉刺激的BCI系统具有极其广阔应用前景。目前认知心理学研究普遍认为视听交互刺激模式可产生比视或听单模态刺激更强的事件相关电位信号,因而可使识别大脑思维模式的正确率更高和响应速度更快,然而BCI研究至今尚难有充分验证其优势的成果。分别从认知心理机制和BCI实验范式两方面综述了视听交互刺激的信息整合机制、视听刺激之间的协同与竞争关系、匹配度对刺激效果的影响及相关BCI实验范式的研究现状;深入分析了视听交互刺激范式未在现有BCI系统中体现其优越性的原因;最后从BCI实验范式选择、系统硬件性能改进、脑电信号处理等方面提出了改进思路并展望了基于视听交互刺激BCI范式研究未来动向。
英文摘要:
      The information of image, voice, and text (language), which is closely related to the human perception of visual and auditory, plays an important role in socioeconomic development and country security assurance. Brain computer interface (BCI) is an innovative technology that directly controls peripheral equipment and makes ‘thought’ into ‘action’ with non muscular methods. Visual and auditory stimuli based BCI system has extremely broad application prospects. It is commonly believed that brain has stronger event related potential, higher reaction accuracy and faster reaction speed on visual auditory crossmodal stimuli (VACS) than single modal stimuli (visual or auditory) in current cognitive psychology researches, while BCI researches have difficulty on the verification of the VACS superiority. In this paper, the VACS researches in cognitive psychology and BCI paradigms were reviewed respectively, which included the information integration mechanism of VACS, the facilitation and competition relationship between visual stimuli and auditory stimuli in VACS system, the influence of congruence and the research status of VACS based BCI paradigms. Also, the reasons for not showing the superiority of VACS in BCI system were discussed. Then, the countermeasure of defusing the difficulties were presented from aspects of the selection of BCI paradigms, the performance improvement of system hardware, the signal processing of electroencephalography(EEG) and so on. In the end, the future trends of VACS based BCI research were presented.
查看全文  查看/发表评论  下载PDF阅读器