人机共享控制机器人系统的应用与发展
|
摘要
康复机器人和辅助机器人可以提高患者生存质量,受到了科研和临床等领域的广泛重视。实现该类机器人的一个重要目的是帮助残疾患者完成日常生活中的活动。其中,人机共享控制机器人系统,充分结合了人类在上层规划和机器在精细控制上的优势,具有很好的控制效果。首先介绍了几种新型的人机交互方式,并对人机共享控制机器人系统的构成与优势进行简要分析;随后结合国内外研究现状,对不同类型的人机共享控制机器人系统进行详细介绍;最后着重从新型人机交互和共享控制两个方面,展望了未来技术的研发方向。
Rehabilitation robot and assistive robot are expected to improve the life quality of patients, which has received extensive attention in basic researches and clinical fields. One of the significant purposes is to help disabled patients perform their daily activities. The human-machine shared control robot system fully takes the advantage of human in upper-level plan and machine in the fine control, which has achieved excellent control ability. First, this study briefly presents the composition and analyzes the advantage of human-machine shared control robot system. Then, based on the review of the domain and abroad works, different types of human-machine shared control robot systems are introduced in detail. Finally, this study looks forward to the future development direction of this technology through two aspects of new human-machine interaction and shared control.
Rehabilitation robot and assistive robot are expected to improve the life quality of patients, which has received extensive attention in basic researches and clinical fields. One of the significant purposes is to help disabled patients perform their daily activities. The human-machine shared control robot system fully takes the advantage of human in upper-level plan and machine in the fine control, which has achieved excellent control ability. First, this study briefly presents the composition and analyzes the advantage of human-machine shared control robot system. Then, based on the review of the domain and abroad works, different types of human-machine shared control robot systems are introduced in detail. Finally, this study looks forward to the future development direction of this technology through two aspects of new human-machine interaction and shared control.
引文
[1] TEJIMA N.Rehabilitation robotics:A review [J].Advanced Robotics,2001,14(7):551- 564.
[2] GOODRICH M A,SCHULTZ A C.Human-robot interaction:A survey [J].Foundations and Trends in Human-Computer Interaction,2008,1(3):203- 275.
[3] BI L ZH,FAN X A,LIU Y L.EEG-based brain-controlled mobile robots:A survey [J].IEEE Transactions on Human-machine Systems,2013,43(2):161-176.
[4] NAM Y,KOO B,CICHOCKI A,et al.GOM-Face:GKP,EOG,and EMG-based multimodal interface with application to humanoid robot control [J].IEEE Transactions on Biomedical Engineering,2014,61(2):453- 462.
[5] HUANG D,QIAN K,FEI D Y,et al.Electroencephalography (EEG)-based brain-computer interface (BCI):A 2-D virtual wheelchair control based on event-related desynchronization/synchronization and state control [J].IEEE Transactions on Neural Systems and Rehabilitation Engineering,2012,20(3):379-388.
[6] PINHEIRO P G,CARDOZO E,PINHEIRO C G.Anticipative shared control for robotic wheelchairs used by people with disabilities [C].IEEE International Conference on Autonomous Robot Systems and Competitions,2015:91-96.
[7] MAO X Q,LI M F,LI W,et al.Progress in EEG-based brain robot interaction systems [J].Computational Intelligence and Neuroscience,2017(2):1- 25.
[8] ZHANG B,WANG J J,FUHLBRIGGE T.A review of the commercial brain-computer interface technology from perspective of industrial robotics [C].IEEE International Conference on Automation and Logistics,2010:379-384.
[9] ALLISON B Z,LEEB R,BRUNNER C,et al.Toward smarter BCIs:Extending BCIs through hybridization and intelligent control [J].Journal of Neural Engineering,2011,9(1):013001.
[10] SIMIC M,TARIQ M,TRIVAILO P.EEG-based BCI control schemes for lower-limb assistive-robots [J].Frontiers in Human Neuroscience,2018(12):312.
[11] 熊鹏文,林虹,宋爱国,等.基于随机森林回归的手臂末端力的软测量方法[J].仪器仪表学报,2017,38(10):2400- 2406.XIONG P W,LIN H,SONG AI G,et al.Soft measurement method of end-of-arm force based on random forest regression [J].Chinese Journal of Scientific Instrument,2017,38(10):2400- 2406.
[12] CHU J U,MOON I,LEE Y J,et al.A supervised feature-projection-based real-time EMG pattern recognition for multifunction myoelectric hand control [J].IEEE/ASME Transactions on Mechatronics,2007,12(3):282- 290.
[13] FUKUDA O,TSUJI T,KANEKO M,et al.A human-assisting manipulator teleoperated by EMG signals and arm motions [J].IEEE Transactions on Robotics and Automation,2003,19(2):210- 222.
[14] SINGH H,SINGH J.Human eye tracking and related issues:A review [J].International Journal of Scientific and Research Publications,2012,2(9):1-9.
[15] HAYHOE M,BALLARD D.Eye movements in natural behavior [J].Trends in Cognitive Sciences,2005,9(4):188-194.
[16] JOHANSSON R S,WESTLING G,B?CKSTR?M A,et al.Eye-hand coordination in object manipulation [J].Journal of Neuroscience,2001,21(17):6917- 6932.
[17] DUCHOWSKI A T.Eye tracking methodology [J].Theory and Practice,2007,328:614.
[18] WANG H,PI J,QIN T,et al.SLAM-based localization of 3D gaze using a mobile eye tracker [C].Proceedings of the ACM Symposium on Eye Tracking Research and Applications,2018:65.
[19] WOLPAW J R,BIRBAUMER N,HEETDERKS W J,et al.Brain-computer interface technology:A review of the first international meeting [J].IEEE Transactions on Rehabilitation Engineering,2000,8(2):164-173.
[20] WOLPAW J,WOLPAW E W.Brain-Computer Interfaces:Principles and Practice [M].Oxford:Oxford University Press,2012.
[21] NIJHOLT A,TAN D,PFURTSCHELLER G,et al.Brain-computer interfacing for intelligent systems [J].IEEE Intelligent Systems,2008,23(3):72-79.
[22] MILLáN J R,RENKENS F,MOURINO J,et al.Noninvasive brain-actuated control of a mobile robot by human EEG [J].IEEE Transactions on Biomedical Engineering,2004,51(6):1026-1033.
[23] 李鹏海,许敏鹏,万柏坤,等.视觉诱发电位脑-机接口实验范式研究进展[J].仪器仪表学报,2016,37(10):2340- 2351.LI P H,XU M P,WAN B K,et al.Review of experimental paradigms in brain-computer interface based on visual evoked potential [J].Chinese Journal of Scientific Instrument,2016,37(10):2340- 2351.
[24] HUO X,GHOVANLOO M.Using unconstrained tongue motion as an alternative control mechanism for wheeled mobility [J].IEEE Transactions on Biomedical Engineering,2009,56(6):1719-1726.
[25] 王仲朋,陈龙,何峰,等.面向康复与辅助应用的脑-机接口趋势与展望[J].仪器仪表学报,2017,38(6):1307-1318.WANG ZH P,CHEN L,HE F,et al.Development trend and prospect of BCI technology facing rehabilitation and assisting applications [J].Chinese Journal of Scientific Instrument,2017,38(6):1307-1318.
[26] GAJWANI P S,CHHABRIA S A.Eye motion tracking for wheelchair control [J].International Journal of Information Technology,2010,2(2):185-187.
[27] RECHY-RAMIREZ E J,HU H,MCDONALD-MAIER K.Head movements based control of an intelligent wheelchair in an indoor environment [C].2012 IEEE International Conference on Robotics and Biomimetics (ROBIO),2012:1464-1469.
[28] ROSS A,JAIN A.Information fusion in biometrics [J].Pattern Recognition Letters,2003,24(13):2115- 2125.
[29] SHAHIN M K,THARWAT A,GABER T,et al.A wheelchair control system using human-machine interaction:Single-modal and multimodal approaches [J].Journal of Intelligent Systems,2019,28(1):115-132.
[30] 胡章芳,张力,徐渝松,等.混合脑机接口的研究现状及应用[J].重庆邮电大学学报 (自然科学版),2018,30(4):511- 517.HU ZH F,ZHANG L,XU Y S,et al.Research status and application based on hybrid brain computer interface [J].Journal of Chongqing University of Posts and Telecommunications (Natural Science Edition),2018,30(4):511- 517.
[31] LEEB R,SAGHA H,CHAVARRIAGA R,et al.A hybrid brain-computer interface based on the fusion of electroencephalographic and electromyographic activities [J].Journal of Neural Engineering,2011,8(2):025011.
[32] 谢平,陈迎亚,郝艳彪,等.基于脑肌电融合的混合脑机接口研究[J].中国生物医学工程学报,2016,35(1):20-30.XIE P,CHEN Y Y,HAO Y B,et al.Multimodal fusion of EEG and EMG signals for a hybrid BCI [J].Chinese Journal of Biomedical Engineering,2016,35(1):20-30.
[33] 谢平,齐孟松,张园园,等.基于多生理信息及迁移学习的驾驶疲劳评估[J].仪器仪表学报,2018,39(10):223- 231.XIE P,QI M S,ZHANG Y Y,et al.Multimodal fusion of EEG and EMG signals for a hybrid BCI [J].Chinese Journal of Scientific Instrument,2018,39(10):223- 231.
[34] RIENER R,DUSCHAU-WICKE A,K?NIG A,et al.Automation in rehabilitation:How to include the human into the loop [C].World Congress on Medical Physics and Biomedical Engineering,2009:180-183.
[35] ESCOLANO C,ANTELIS J M,MINGUEZ J.A telepresence mobile robot controlled with a noninvasive brain-computer interface [J].IEEE Transactions on Systems,Man,and Cybernetics,Part B (Cybernetics),2012,42(3):793- 804.
[36] CHEN S C,WU C M,ZAENI I A,et al.Applying fuzzy decision for a single channel SSVEP-based BCI on automatic feeding robot [J].Microsystem Technologies,2018,24(1):199- 207.
[37] MENG J,ZHANG S,BEKYO A,et al.Noninvasive electroencephalogram based control of a robotic arm for reach and grasp tasks [J].Scientific Reports,2016,6(1):38565.
[38] WU H,YANG C,WANG N,et al.Manipulation of a robot arm in 3D space by using EEG signals [C].2nd International Conference on Advanced Robotics and Mechatronics (ICARM),2017:608- 613.
[39] TONIN L,LEEB R,TAVELLA M,et al.The role of shared-control in BCI-based telepresence [C].IEEE International Conference on Systems,Man and Cybernetics,2010:1462-1466.
[40] LEEB R,TONIN L,ROHM M,et al.Towards independence:A BCI telepresence robot for people with severe motor disabilities [J].Proceedings of the IEEE,2015,103(6):969-982.
[41] TSUI C S L,JIA P,GAN J Q,et al.EMG-based hands-free wheelchair control with EOG attention shift detection [C].IEEE International Conference on Robotics and Biomimetics (ROBIO),2007:1266-1271.
[42] CHEN S C,CHEN Y J,ZAENI I A,et al.A single-channel SSVEP-Based BCI with a fuzzy feature threshold algorithm in a maze game [J].International Journal of Fuzzy Systems,2017,19(2):553- 565.
[43] ZHAO S N,LI ZH J,CUI R X,et al.Brain-machine interfacing-based teleoperation of multiple coordinated mobile robots [J].IEEE Transactions on Industrial Electronics,2017,64(6):5161- 5170.
[44] LI ZH J,ZHAO S N,DUAN J,et al.Human cooperative wheelchair with brain-machine interaction based on shared control strategy [J].IEEE/ASME Transactions on Mechatronics,2017,22(1):185-195.
[45] GALáN F,NUTTIN M,LEW E,et al.A brain-actuated wheelchair:Asynchronous and non-invasive brain-computer interfaces for continuous control of robots [J].Clinical Neurophysiology,2008,119(9):2159- 2169.
[46] ZHANG W,SUN F,CHEN J,et al.An asynchronous MI-based BCI for brain-actuated robot grasping control [C].International Conference on Computer Systems,Electronics and Control (ICCSEC),2017:893- 898.
[47] EZEH C,TRAUTMAN P,HOLLOWAY C,et al.Comparing shared control approaches for alternative interfaces:A wheelchair simulator experiment [C].2017 IEEE International Conference on Systems,Man,and Cybernetics (SMC),2017:93-98.
[48] SUN F CH,ZHANG W CH,CHEN J H,et al.Fused fuzzy petri nets:A shared control method for brain computer interface systems [J].IEEE Transactions on Cognitive and Developmental Systems,2018,3(1):1-13.
[49] LIU R,WANG Y X,ZHANG L.An FDES-based shared control method for asynchronous brain-actuated robot [J].IEEE Transactions on Cybernetics,2016,46(6):1452-1462.
[50] LOPES A C,NUNES U,VAZ L,et al.Assisted navigation based on shared-control,using discrete and sparse human-machine interfaces [C].2010 Annual International Conference of the IEEE Engineering in Medicine and Biology,2010:471- 474.
[51] MCMULLEN D P,HOTSON G,KATYAL K D,et al.Demonstration of a semi-autonomous hybrid brain-machine interface using human intracranial EEG,eye tracking,and computer vision to control a robotic upper limb prosthetic [J].IEEE Transactions on Neural Systems and Rehabilitation Engineering,2014,22(4):784-796.
[52] MUELLING K,VENKATRAMAN A,VALOIS J S,et al.Autonomy infused teleoperation with application to brain computer interface controlled manipulation [J].Autonomous Robots,2017,41(6):1401-1422.
[53] HU Y B,LI ZH J,LI G L,et al.Development of sensory-motor fusion-based manipulation and grasping control for a robotic hand-eye system [J].IEEE Transactions on Systems,Man,and Cybernetics:Systems,2017,47(7):1169-1180.
[54] WANG Y,LI ZH J.Brain teleoperation control of a nonholonomic mobile robot using quadrupole potential function [J].IEEE Transactions on Cognitive and Developmental Systems,2018,9(1):1-12.
[55] YANG CH G,WU H W,LI ZH J,et al.Mind control of a robotic arm with visual fusion technology [J].IEEE Transactions on Industrial Informatics,2018,14(9):3822-3830.
[56] ZHANG W CH,SUN F CH,LIU CH F,et al.A hybrid EEG-based BCI for robot grasp controlling [C].IEEE International Conference on Systems,Man,and Cybernetics (SMC),2017:3278-3283.
[57] PETIT D,GERGONDET P,CHERUBINI A,et al.An integrated framework for humanoid embodiment with a BCI [C].IEEE International Conference on Robotics and Automation (ICRA),2015:2882- 2887.
[58] SCHR?ER S,KILLMANN I,FRANK B,et al.An autonomous robotic assistant for drinking [C].IEEE International Conference on Robotics and Automation (ICRA),2015:6482- 6487.
[59] ZHANG ZH J,HUANG Y Q,CHEN S Y,et al.An intention-driven semi-autonomous intelligent robotic system for drinking [J].Frontiers in Neurorobotics,2017(11):48.
[60] SHENG SH L,SONG P P,XIE L Y,et al.Design of an SSVEP-based BCI system with visual servo module for a service robot to execute multiple tasks [C].IEEE International Conference on Robotics and Automation (ICRA),2017:2267- 2272.
[61] BURGET F,FIEDERER L D J,KUHNER D,et al.Acting thoughts:Towards a mobile robotic service assistant for users with limited communication skills [C].European Conference on Mobile Robots (ECMR),2017:1- 6.
[62] ZHANG R,LI Y Q,YAN Y Y,et al.Control of a wheelchair in an indoor environment based on a brain-computer interface and automated navigation [J].IEEE Transactions on Neural Systems and Rehabilitation Engineering,2016,24(1):128-139.
[63] TANG J,ZHOU Z.A shared-control based BCI system:For a robotic arm control [C].1st International Conference on Electronics Instrumentation & Information Systems (EIIS),2017:1- 5.
[64] 安兴伟,曹勇,焦学军,等.基于视听交互刺激的认知机理与脑机接口范式研究进展[J].电子测量与仪器学报,2017,31(7):983-993.AN X W,CAO Y,JIAO X J,et al.Research on cognitive mechanism and brain-computer interface application in visual-auditory crossmodal stimuli [J].Journal of Electronic Measurement & Instrumentation,2017,31(7):983-993.
[65] 张大伟,孟森森,邓计才.多移动微小型机器人编队控制与协作避碰研究[J].仪器仪表学报,2017,38(3):578- 585.ZHANG D W,MENG S S,DENG J C.Formation control and cooperative collision avoidance for multiple mobile miniature robots [J].Chinese Journal of Scientific Instrument,2017,38(3):578- 585.
[66] CREA S,NANN M,TRIGILI E,et al.Feasibility and safety of shared EEG/EOG and vision-guided autonomous whole-arm exoskeleton control to perform activities of daily living [J].Scientific Reports,2018,8(1):10823.
[67] ARRICHIELLO F,LILLO P D,VITO D D,et al.Assistive robot operated via p300-based brain computer interface [C].IEEE International Conference on Robotics and Automation (ICRA),2017:6032- 6037.
[68] ZENG H,WANG Y X,WU CH CH,et al.Closed-loop hybrid gaze brain-machine interface based robotic arm control with augmented reality feedback [J].Frontiers in Neurorobotics,2017(11):60.
[69] PEZZULO G,OGNIBENE D.Proactive action preparation:Seeing action preparation as a continuous and proactive process [J].Motor Control,2012,16(3):386- 424.
[70] TAKANO K,HATA N,NAKAJIMA Y,et al.Augmented reality-brain-machine interface operated with a see-through head mount display [J].Neuroscience Research,2010,68(1):e106.
[71] ROESCHLEIN R,DOMHOLDT E.Factors related to successful upper extremity prosthetic use [J].Prosthetics and Orthotics International,1989,13(1):14-18.
[72] PYLATIUK C,MOUNIER S,KARGOV A,et al.Progress in the development of a multifunctional hand prosthesis [C].26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society,2004:4260- 4263.
[73] CIPRIANI C,ZACCONE F,MICERA S,et al.On the shared control of an EMG-controlled prosthetic hand:analysis of user-prosthesis interaction [J].IEEE Transactions on Robotics,2008,24(1):170-184.
[74] MILLIKEN L,HOLLINGER G A.Modeling user expertise for choosing levels of shared autonomy [C].IEEE International Conference on Robotics and Automation (ICRA),2017:2285- 2291.
[75] DRAGAN A D,SRINIVASA S S.A policy-blending formalism for shared control [J].International Journal of Robotics Research,2013,32(7):790- 805.
[76] DRAGAN A D,SRINIVASA S S,LEE K C.Teleoperation with intelligent and customizable interfaces [J].Journal of Human-Robot Interaction,2013,2(2):33- 57.
[2] GOODRICH M A,SCHULTZ A C.Human-robot interaction:A survey [J].Foundations and Trends in Human-Computer Interaction,2008,1(3):203- 275.
[3] BI L ZH,FAN X A,LIU Y L.EEG-based brain-controlled mobile robots:A survey [J].IEEE Transactions on Human-machine Systems,2013,43(2):161-176.
[4] NAM Y,KOO B,CICHOCKI A,et al.GOM-Face:GKP,EOG,and EMG-based multimodal interface with application to humanoid robot control [J].IEEE Transactions on Biomedical Engineering,2014,61(2):453- 462.
[5] HUANG D,QIAN K,FEI D Y,et al.Electroencephalography (EEG)-based brain-computer interface (BCI):A 2-D virtual wheelchair control based on event-related desynchronization/synchronization and state control [J].IEEE Transactions on Neural Systems and Rehabilitation Engineering,2012,20(3):379-388.
[6] PINHEIRO P G,CARDOZO E,PINHEIRO C G.Anticipative shared control for robotic wheelchairs used by people with disabilities [C].IEEE International Conference on Autonomous Robot Systems and Competitions,2015:91-96.
[7] MAO X Q,LI M F,LI W,et al.Progress in EEG-based brain robot interaction systems [J].Computational Intelligence and Neuroscience,2017(2):1- 25.
[8] ZHANG B,WANG J J,FUHLBRIGGE T.A review of the commercial brain-computer interface technology from perspective of industrial robotics [C].IEEE International Conference on Automation and Logistics,2010:379-384.
[9] ALLISON B Z,LEEB R,BRUNNER C,et al.Toward smarter BCIs:Extending BCIs through hybridization and intelligent control [J].Journal of Neural Engineering,2011,9(1):013001.
[10] SIMIC M,TARIQ M,TRIVAILO P.EEG-based BCI control schemes for lower-limb assistive-robots [J].Frontiers in Human Neuroscience,2018(12):312.
[11] 熊鹏文,林虹,宋爱国,等.基于随机森林回归的手臂末端力的软测量方法[J].仪器仪表学报,2017,38(10):2400- 2406.XIONG P W,LIN H,SONG AI G,et al.Soft measurement method of end-of-arm force based on random forest regression [J].Chinese Journal of Scientific Instrument,2017,38(10):2400- 2406.
[12] CHU J U,MOON I,LEE Y J,et al.A supervised feature-projection-based real-time EMG pattern recognition for multifunction myoelectric hand control [J].IEEE/ASME Transactions on Mechatronics,2007,12(3):282- 290.
[13] FUKUDA O,TSUJI T,KANEKO M,et al.A human-assisting manipulator teleoperated by EMG signals and arm motions [J].IEEE Transactions on Robotics and Automation,2003,19(2):210- 222.
[14] SINGH H,SINGH J.Human eye tracking and related issues:A review [J].International Journal of Scientific and Research Publications,2012,2(9):1-9.
[15] HAYHOE M,BALLARD D.Eye movements in natural behavior [J].Trends in Cognitive Sciences,2005,9(4):188-194.
[16] JOHANSSON R S,WESTLING G,B?CKSTR?M A,et al.Eye-hand coordination in object manipulation [J].Journal of Neuroscience,2001,21(17):6917- 6932.
[17] DUCHOWSKI A T.Eye tracking methodology [J].Theory and Practice,2007,328:614.
[18] WANG H,PI J,QIN T,et al.SLAM-based localization of 3D gaze using a mobile eye tracker [C].Proceedings of the ACM Symposium on Eye Tracking Research and Applications,2018:65.
[19] WOLPAW J R,BIRBAUMER N,HEETDERKS W J,et al.Brain-computer interface technology:A review of the first international meeting [J].IEEE Transactions on Rehabilitation Engineering,2000,8(2):164-173.
[20] WOLPAW J,WOLPAW E W.Brain-Computer Interfaces:Principles and Practice [M].Oxford:Oxford University Press,2012.
[21] NIJHOLT A,TAN D,PFURTSCHELLER G,et al.Brain-computer interfacing for intelligent systems [J].IEEE Intelligent Systems,2008,23(3):72-79.
[22] MILLáN J R,RENKENS F,MOURINO J,et al.Noninvasive brain-actuated control of a mobile robot by human EEG [J].IEEE Transactions on Biomedical Engineering,2004,51(6):1026-1033.
[23] 李鹏海,许敏鹏,万柏坤,等.视觉诱发电位脑-机接口实验范式研究进展[J].仪器仪表学报,2016,37(10):2340- 2351.LI P H,XU M P,WAN B K,et al.Review of experimental paradigms in brain-computer interface based on visual evoked potential [J].Chinese Journal of Scientific Instrument,2016,37(10):2340- 2351.
[24] HUO X,GHOVANLOO M.Using unconstrained tongue motion as an alternative control mechanism for wheeled mobility [J].IEEE Transactions on Biomedical Engineering,2009,56(6):1719-1726.
[25] 王仲朋,陈龙,何峰,等.面向康复与辅助应用的脑-机接口趋势与展望[J].仪器仪表学报,2017,38(6):1307-1318.WANG ZH P,CHEN L,HE F,et al.Development trend and prospect of BCI technology facing rehabilitation and assisting applications [J].Chinese Journal of Scientific Instrument,2017,38(6):1307-1318.
[26] GAJWANI P S,CHHABRIA S A.Eye motion tracking for wheelchair control [J].International Journal of Information Technology,2010,2(2):185-187.
[27] RECHY-RAMIREZ E J,HU H,MCDONALD-MAIER K.Head movements based control of an intelligent wheelchair in an indoor environment [C].2012 IEEE International Conference on Robotics and Biomimetics (ROBIO),2012:1464-1469.
[28] ROSS A,JAIN A.Information fusion in biometrics [J].Pattern Recognition Letters,2003,24(13):2115- 2125.
[29] SHAHIN M K,THARWAT A,GABER T,et al.A wheelchair control system using human-machine interaction:Single-modal and multimodal approaches [J].Journal of Intelligent Systems,2019,28(1):115-132.
[30] 胡章芳,张力,徐渝松,等.混合脑机接口的研究现状及应用[J].重庆邮电大学学报 (自然科学版),2018,30(4):511- 517.HU ZH F,ZHANG L,XU Y S,et al.Research status and application based on hybrid brain computer interface [J].Journal of Chongqing University of Posts and Telecommunications (Natural Science Edition),2018,30(4):511- 517.
[31] LEEB R,SAGHA H,CHAVARRIAGA R,et al.A hybrid brain-computer interface based on the fusion of electroencephalographic and electromyographic activities [J].Journal of Neural Engineering,2011,8(2):025011.
[32] 谢平,陈迎亚,郝艳彪,等.基于脑肌电融合的混合脑机接口研究[J].中国生物医学工程学报,2016,35(1):20-30.XIE P,CHEN Y Y,HAO Y B,et al.Multimodal fusion of EEG and EMG signals for a hybrid BCI [J].Chinese Journal of Biomedical Engineering,2016,35(1):20-30.
[33] 谢平,齐孟松,张园园,等.基于多生理信息及迁移学习的驾驶疲劳评估[J].仪器仪表学报,2018,39(10):223- 231.XIE P,QI M S,ZHANG Y Y,et al.Multimodal fusion of EEG and EMG signals for a hybrid BCI [J].Chinese Journal of Scientific Instrument,2018,39(10):223- 231.
[34] RIENER R,DUSCHAU-WICKE A,K?NIG A,et al.Automation in rehabilitation:How to include the human into the loop [C].World Congress on Medical Physics and Biomedical Engineering,2009:180-183.
[35] ESCOLANO C,ANTELIS J M,MINGUEZ J.A telepresence mobile robot controlled with a noninvasive brain-computer interface [J].IEEE Transactions on Systems,Man,and Cybernetics,Part B (Cybernetics),2012,42(3):793- 804.
[36] CHEN S C,WU C M,ZAENI I A,et al.Applying fuzzy decision for a single channel SSVEP-based BCI on automatic feeding robot [J].Microsystem Technologies,2018,24(1):199- 207.
[37] MENG J,ZHANG S,BEKYO A,et al.Noninvasive electroencephalogram based control of a robotic arm for reach and grasp tasks [J].Scientific Reports,2016,6(1):38565.
[38] WU H,YANG C,WANG N,et al.Manipulation of a robot arm in 3D space by using EEG signals [C].2nd International Conference on Advanced Robotics and Mechatronics (ICARM),2017:608- 613.
[39] TONIN L,LEEB R,TAVELLA M,et al.The role of shared-control in BCI-based telepresence [C].IEEE International Conference on Systems,Man and Cybernetics,2010:1462-1466.
[40] LEEB R,TONIN L,ROHM M,et al.Towards independence:A BCI telepresence robot for people with severe motor disabilities [J].Proceedings of the IEEE,2015,103(6):969-982.
[41] TSUI C S L,JIA P,GAN J Q,et al.EMG-based hands-free wheelchair control with EOG attention shift detection [C].IEEE International Conference on Robotics and Biomimetics (ROBIO),2007:1266-1271.
[42] CHEN S C,CHEN Y J,ZAENI I A,et al.A single-channel SSVEP-Based BCI with a fuzzy feature threshold algorithm in a maze game [J].International Journal of Fuzzy Systems,2017,19(2):553- 565.
[43] ZHAO S N,LI ZH J,CUI R X,et al.Brain-machine interfacing-based teleoperation of multiple coordinated mobile robots [J].IEEE Transactions on Industrial Electronics,2017,64(6):5161- 5170.
[44] LI ZH J,ZHAO S N,DUAN J,et al.Human cooperative wheelchair with brain-machine interaction based on shared control strategy [J].IEEE/ASME Transactions on Mechatronics,2017,22(1):185-195.
[45] GALáN F,NUTTIN M,LEW E,et al.A brain-actuated wheelchair:Asynchronous and non-invasive brain-computer interfaces for continuous control of robots [J].Clinical Neurophysiology,2008,119(9):2159- 2169.
[46] ZHANG W,SUN F,CHEN J,et al.An asynchronous MI-based BCI for brain-actuated robot grasping control [C].International Conference on Computer Systems,Electronics and Control (ICCSEC),2017:893- 898.
[47] EZEH C,TRAUTMAN P,HOLLOWAY C,et al.Comparing shared control approaches for alternative interfaces:A wheelchair simulator experiment [C].2017 IEEE International Conference on Systems,Man,and Cybernetics (SMC),2017:93-98.
[48] SUN F CH,ZHANG W CH,CHEN J H,et al.Fused fuzzy petri nets:A shared control method for brain computer interface systems [J].IEEE Transactions on Cognitive and Developmental Systems,2018,3(1):1-13.
[49] LIU R,WANG Y X,ZHANG L.An FDES-based shared control method for asynchronous brain-actuated robot [J].IEEE Transactions on Cybernetics,2016,46(6):1452-1462.
[50] LOPES A C,NUNES U,VAZ L,et al.Assisted navigation based on shared-control,using discrete and sparse human-machine interfaces [C].2010 Annual International Conference of the IEEE Engineering in Medicine and Biology,2010:471- 474.
[51] MCMULLEN D P,HOTSON G,KATYAL K D,et al.Demonstration of a semi-autonomous hybrid brain-machine interface using human intracranial EEG,eye tracking,and computer vision to control a robotic upper limb prosthetic [J].IEEE Transactions on Neural Systems and Rehabilitation Engineering,2014,22(4):784-796.
[52] MUELLING K,VENKATRAMAN A,VALOIS J S,et al.Autonomy infused teleoperation with application to brain computer interface controlled manipulation [J].Autonomous Robots,2017,41(6):1401-1422.
[53] HU Y B,LI ZH J,LI G L,et al.Development of sensory-motor fusion-based manipulation and grasping control for a robotic hand-eye system [J].IEEE Transactions on Systems,Man,and Cybernetics:Systems,2017,47(7):1169-1180.
[54] WANG Y,LI ZH J.Brain teleoperation control of a nonholonomic mobile robot using quadrupole potential function [J].IEEE Transactions on Cognitive and Developmental Systems,2018,9(1):1-12.
[55] YANG CH G,WU H W,LI ZH J,et al.Mind control of a robotic arm with visual fusion technology [J].IEEE Transactions on Industrial Informatics,2018,14(9):3822-3830.
[56] ZHANG W CH,SUN F CH,LIU CH F,et al.A hybrid EEG-based BCI for robot grasp controlling [C].IEEE International Conference on Systems,Man,and Cybernetics (SMC),2017:3278-3283.
[57] PETIT D,GERGONDET P,CHERUBINI A,et al.An integrated framework for humanoid embodiment with a BCI [C].IEEE International Conference on Robotics and Automation (ICRA),2015:2882- 2887.
[58] SCHR?ER S,KILLMANN I,FRANK B,et al.An autonomous robotic assistant for drinking [C].IEEE International Conference on Robotics and Automation (ICRA),2015:6482- 6487.
[59] ZHANG ZH J,HUANG Y Q,CHEN S Y,et al.An intention-driven semi-autonomous intelligent robotic system for drinking [J].Frontiers in Neurorobotics,2017(11):48.
[60] SHENG SH L,SONG P P,XIE L Y,et al.Design of an SSVEP-based BCI system with visual servo module for a service robot to execute multiple tasks [C].IEEE International Conference on Robotics and Automation (ICRA),2017:2267- 2272.
[61] BURGET F,FIEDERER L D J,KUHNER D,et al.Acting thoughts:Towards a mobile robotic service assistant for users with limited communication skills [C].European Conference on Mobile Robots (ECMR),2017:1- 6.
[62] ZHANG R,LI Y Q,YAN Y Y,et al.Control of a wheelchair in an indoor environment based on a brain-computer interface and automated navigation [J].IEEE Transactions on Neural Systems and Rehabilitation Engineering,2016,24(1):128-139.
[63] TANG J,ZHOU Z.A shared-control based BCI system:For a robotic arm control [C].1st International Conference on Electronics Instrumentation & Information Systems (EIIS),2017:1- 5.
[64] 安兴伟,曹勇,焦学军,等.基于视听交互刺激的认知机理与脑机接口范式研究进展[J].电子测量与仪器学报,2017,31(7):983-993.AN X W,CAO Y,JIAO X J,et al.Research on cognitive mechanism and brain-computer interface application in visual-auditory crossmodal stimuli [J].Journal of Electronic Measurement & Instrumentation,2017,31(7):983-993.
[65] 张大伟,孟森森,邓计才.多移动微小型机器人编队控制与协作避碰研究[J].仪器仪表学报,2017,38(3):578- 585.ZHANG D W,MENG S S,DENG J C.Formation control and cooperative collision avoidance for multiple mobile miniature robots [J].Chinese Journal of Scientific Instrument,2017,38(3):578- 585.
[66] CREA S,NANN M,TRIGILI E,et al.Feasibility and safety of shared EEG/EOG and vision-guided autonomous whole-arm exoskeleton control to perform activities of daily living [J].Scientific Reports,2018,8(1):10823.
[67] ARRICHIELLO F,LILLO P D,VITO D D,et al.Assistive robot operated via p300-based brain computer interface [C].IEEE International Conference on Robotics and Automation (ICRA),2017:6032- 6037.
[68] ZENG H,WANG Y X,WU CH CH,et al.Closed-loop hybrid gaze brain-machine interface based robotic arm control with augmented reality feedback [J].Frontiers in Neurorobotics,2017(11):60.
[69] PEZZULO G,OGNIBENE D.Proactive action preparation:Seeing action preparation as a continuous and proactive process [J].Motor Control,2012,16(3):386- 424.
[70] TAKANO K,HATA N,NAKAJIMA Y,et al.Augmented reality-brain-machine interface operated with a see-through head mount display [J].Neuroscience Research,2010,68(1):e106.
[71] ROESCHLEIN R,DOMHOLDT E.Factors related to successful upper extremity prosthetic use [J].Prosthetics and Orthotics International,1989,13(1):14-18.
[72] PYLATIUK C,MOUNIER S,KARGOV A,et al.Progress in the development of a multifunctional hand prosthesis [C].26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society,2004:4260- 4263.
[73] CIPRIANI C,ZACCONE F,MICERA S,et al.On the shared control of an EMG-controlled prosthetic hand:analysis of user-prosthesis interaction [J].IEEE Transactions on Robotics,2008,24(1):170-184.
[74] MILLIKEN L,HOLLINGER G A.Modeling user expertise for choosing levels of shared autonomy [C].IEEE International Conference on Robotics and Automation (ICRA),2017:2285- 2291.
[75] DRAGAN A D,SRINIVASA S S.A policy-blending formalism for shared control [J].International Journal of Robotics Research,2013,32(7):790- 805.
[76] DRAGAN A D,SRINIVASA S S,LEE K C.Teleoperation with intelligent and customizable interfaces [J].Journal of Human-Robot Interaction,2013,2(2):33- 57.