类脑智能技术在无人系统上的应用
|
摘要
随着人工智能与脑科学等前沿技术的迅速发展,无人系统智能化研究正逐渐成为当今世界强国重点关注的战略发展方向,研究与之相关的科学问题具有前瞻性、战略性和带动性.文章首先分析了无人系统的发展需求,提出了面向需求的若干关键问题,包括复杂环境与态势信息的感知与认知问题、整体效能最优的分布式任务决策问题、面向任务需求的路径实时规划问题、考虑高不确定环境的自学习控制问题、应对非预期情况的故障诊断及容错问题以及基于人机接口的人机交互问题;随后,系统阐述了类脑智能技术在解决这些问题上的国内外研究现状;最后,论述了无人系统类脑智能化发展中依然存在的问题及未来发展趋势.
With the rapid advancement of artificial intelligence and brain science technology, intelligent unmanned vehicles is becoming the strategic development direction for world powers today, and the research of related scientific problems are forward-looking, strategic and strong in promotion. This paper first analyzes the development requirements of unmanned vehicles, based on which several requirement-oriented key problems is put forward, including the perception and cognition problem of the complex environment and situation, the distributed task decision problem subject to optimal overall effectiveness, the real-time path planning problem satisfying task requirement, the self-learning control problem under high uncertainty environment, the fault diagnosis and fault tolerance problem in response to unexpected situation and the human-machine interaction problem based on human-machine interaction equipment. Then, the current research status of brain intelligent technology in solving these problems at home and abroad is discussed. Finally, this paper summarizes the existing problems and presents the prospects in the development of intelligent unmanned vehicles.
With the rapid advancement of artificial intelligence and brain science technology, intelligent unmanned vehicles is becoming the strategic development direction for world powers today, and the research of related scientific problems are forward-looking, strategic and strong in promotion. This paper first analyzes the development requirements of unmanned vehicles, based on which several requirement-oriented key problems is put forward, including the perception and cognition problem of the complex environment and situation, the distributed task decision problem subject to optimal overall effectiveness, the real-time path planning problem satisfying task requirement, the self-learning control problem under high uncertainty environment, the fault diagnosis and fault tolerance problem in response to unexpected situation and the human-machine interaction problem based on human-machine interaction equipment. Then, the current research status of brain intelligent technology in solving these problems at home and abroad is discussed. Finally, this paper summarizes the existing problems and presents the prospects in the development of intelligent unmanned vehicles.
引文
[1]PU Muming,XU Bo,TAN Tieniu.Brain science and brain-inspired intelligence technology-an overview.Bulletin of Chinese Academy of Sciences,2016,31(7):725-736.(蒲慕明,徐波,谭铁牛.脑科学与类脑研究概述.中国科学院院刊,2016,31(7):725-736.)
[2]ZENG Yi,LIU Chenglin,TAN Tieniu.Retrospect and outlook of brain-inpired intelligence research.Chinese Journal of Computers,2016,1(1):212-222.(曾毅,刘成林,谭铁牛.类脑智能研究的回顾与展望.计算机学报,2016,1(1):212-222.)
[3]XU Bo,LIU Chenglin,ZENG Yi.Research status and developments of brain-inspired intelligence.Bulletin of Chinese Academy of Sciences,2016,31(7):793-802.(徐波,刘成林,曾毅.类脑智能研究现状与发展思考.中国科学院院刊,2016,31(7):793-802.)
[4]CAMBONE A S,KRIEG J K,PACE P,et al.Unmanned Aircraft Systems Roadmap 2005-2030.US:Office of the Secretary of Defense.2005.
[5]SHU Z,JIA Q,LI X,et al.An ooda loop-based function network modeling and simulation evaluation method for combat system-ofsystems.Theory,Methodology,Tools and Applications for Modeling and Simulation of Complex Systems.Singapore:Springer,2016:393-402.
[6]LECUN Y,BENGIO Y,HINTON G.Deep learning.Nature,2015,521(7553):436-444.
[7]GIRSHICK R,DONAHUE J,DARREL T,et al.Rich feature hierarchies for accurate object detection and semantic segmentation.Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Columbus:IEEE,2014:580-587.
[8]REN S,HE K,GIRSHICK R,et al.Faster R-CNN:towards realtime object detection with region proposal networks.Advances in Neural Information Processing Systems 28.Montreal:Springer,2015:91-99.
[9]REDMON J,DIVVALA S,GIRSHICK R,et al.You only look once:unified,real-time object detection.Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Lasvegas:IEEE,2016:779-788.
[10]GIRSHICK R,DONAHUE J,DARREL T,et al.Rich feature hierarchies for accurate object detection and semantic segmentation.Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Boston:IEEE,2014:580-587.
[11]LEE J,WANG J,CRANDALL D,et al.Real-time,cloud-based object detection for unmanned aerial vehicles.IEEE International Conference on Robotic Computing.Taichung:IEEE,2017:36-43.
[12]LIU W,ANGUELOV D,ERHAN D,et al.SSD:Single shot multibox detector.European Conference on Computer Vision.Cham:Springer,2016:21-37.
[13]ZHOU B,LAPEDRIZA A,XIAO J,et al.Learning deep features for scene recognition using places database.International Conference on Neural Information Processing Systems.Montreal:Springer,2014:487-495.
[14]PENATTI O A B,NOGUEIRA K,SANTOS J A D.Do deep features generalize from everyday objects to remote sensing and aerial scenes domains.Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Boston:IEEE,2015:44-51.
[15]HU F,XIA G S,HU J,et al.Transferring deep convolutional neural networks for the scene classification of high-resolution remote sensing imagery.Remote Sensing,2015,7(11):14680-14707.
[16]AMIR G,VASSILIS A.Selective unsupervised feature learning with convolutional neural network(S-CNN).Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Mexico:IEEE,2016:2486-2490.
[17]CHEN Y,ZHAO D,LV L,et al.Multi-task learning for dangerous object detection in autonomous driving.Information Sciences,2018,432(3):559-571.
[18]GIUSTI A,GUZZI J,DAN C C,et al.A machine learning approach to visual perception of forest trails for mobile robots.IEEE Robotics and Automation Letters,2016,1(2):661-667.
[19]HUNG C,ZHE X,SUKKARIEH S.Feature learning based approach for weed classification using high resolution aerial images from a digital camera mounted on a UAV.Remote Sensing,2014,6(12):12037-12054.
[20]CHEN S W,SKANDAN S S,DCUNHA S,et al.Counting apples and oranges with deep learning:a data driven approach.IEEERobotics&Automation Letters,2017,2(2):781-788.
[21]LI W,FU H,YU L,et al.Deep learning based oil palm tree detection and counting for high-resolution remote sensing images.Remote Sensing,2016,9(1):22-31.
[22]KRIZHEVSKY A,SUTSKEVER I,HINTON G E.ImageNet classification with deep convolutional neural networks.International Conference on Neural Information Processing Systems.Nevada:Springer,2012:1097-1105.
[23]KIM H,KIM D,JUNG S,et al.Development of a UAV-type jellyfish monitoring system using deep learning.International Conference on Ubiquitous Robots and Ambient Intelligence.Xi’an:IEEE,2015:495-497.
[24]BEJIGA M,ZEGGADA A,NOUFFIDJ A,et al.A convolutional neural network approach for assisting avalanche search and rescue operations with UAV imagery.Remote Sensing,2017,9(2):100-108.
[25]SAWARKAR A,CHAUDHARI V,CHAVAN R,et al.HMD visionbased teleoperating UGV and UAV for hostile environment using deep learning.ArXiv Preprint.2016.arXiv:1609.04147.
[26]KENDALL A,GRIMES M,CIPOLLA R.PoseNet:a convolutional network for real-time 6-DOF camera relocalization.IEEE International Conference on Computer Vision.Santiago:IEEE,2015:2938-2946.
[27]YI K M,TRULLS E,LEPETIT V,et al.LIFT:learned invariant feature transform.European Conference on Computer Vision.Cham:Springer,2016:467-483.
[28]DETONE D,MALISIEWICZ T,RABINOVICH A.Toward geometric deep SLAM.ArXiv Preprint.2017.arXiv:1707.07410.
[29]ZHOU T,BROWN M,SNAVELY N,et al.Unsupervised learning of depth and ego-motion from video.Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Hawaii:IEEE,2017:6612-6619.
[30]TATENO K,TOMBARI F,LAINA I,et al.CNN-SLAM:real-time dense monocular SLAM with learned depth prediction.Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Hawaii:IEEE,2017:6565-6574.
[31]ZHAO Zonggui,XIONG Zhaohua,WANG Ke,et al.Theory,Methodology,Tools and Applications for Modeling and Simulation of Complex Systems.Beijing:National Defense Industry Press,2012.(赵宗贵,熊朝华,王珂,等.信息融合概念方法与应用.北京:国防工业出版社,2012.)
[32]ZHU Feng,HU Xiaofeng.Survey and research progress of battlefield situation assessment based on deep learning.Military Operations and Systems Engineering,2016,30(3):22-27.(朱丰,胡晓峰.基于深度学习的战场态势评估综述与研究展望.军事运筹与系统工程,2016,30(3):22-27.)
[33]SILVER D,HUANG A,MADDISON C J,et al.Mastering the game of go with deep neural networks and tree search.Nature,2016,529(7587):484-489.
[34]LI C,CAO M,TIAN L.Situation assessment approach based on a hierarchic multi-timescale bayesian network.International Conference on Information Science and Control Engineering.Shanghai:IEEE,2015:911-915.
[35]DAS S,GREY R,GONSALVES P.Situation assessment via Bayesian belief networks.Proceedings of the Fifth International Conference on Information Fusion.Annapolis:IEEE,2002:664-671.
[36]MIRMOEINI F,KRISHNAMURTHY V.Reconfigurable Bayesian networks for hierarchical multi-stage situation assessment in battlespace.Conference Record of the Thirty-Ninth Asilomar Conference on Signals,Pacific Grove:IEEE,2005:104-108.
[37]LUO L,CHAKRABORTY N,SYCARA K.Provably-good distributed algorithm for constrained multi-robot task assignment for grouped tasks.IEEE Transactions on Robotics,2015,31(1):19-30.
[38]LEE D H,ZAHEER S A,KIM J H.A Resource-oriented,decentralized auction algorithm for multirobot task allocation.IEEE Transactions on Automation Science&Engineering,2015,12(4):1469-1481
[39]JANG I,SHIN H S,TSOURDOS A.Anonymous hedonic game for task allocation in a large-scale multiple agent system.ArXiv Preprint.2017.arXiv:1711.06871.
[40]JANG I,SHIN H S,TSOURDOS A,et al.An integrated decisionmaking framework of a heterogeneous aerial robotic swarm for cooperative tasks with minimum requirements.Proceedings of the Institution of Mechanical Engineers,Part G:Journal of Aerospace Engineering,2018,DOI:10.1177/0954410018772622.
[41]JANG I,SHIN H S,TSOURDOS A.A comparative study of gametheoretical and markov-chain-based approaches to division of labour in a robotic swarm.IFAC-PapersOnLine,2018,51(12):62-68.
[42]MNIH V,KAVUKCUOGLU K,SILVER D,et al.Playing atari with deep reinforcement learning.ArXiv Preprint.2013.arXiv:1312.5602.
[43]MNIH V,KAVUKCUOGLU K,SILVER D,et al.Human-level control through deep reinforcement learning.Nature,2015,518(7540):529-533.
[44]WANG Chong.Research on distributed cooperative mission planning of earth observation satellite based on agent.Changsha:Military Operations and Systems Engineering,2011.(王冲.基于Agent的对地观测卫星分布式协同任务规划研究.长沙:国防科学技术大学,2011.)
[45]GURZONI J A,TONIDANDEL F,BIANCHI R A C.Market-based dynamic task allocation using heuristically accelerated reinforcement learning.Portuguese Conference on Artificial Intelligence.Berlin:Springer,2012:365-376.
[46]LOPE D J,MARAVALL D,QUINONEZ Y.Self-organizing techniques to improve the decentralized multi-task distribution in multirobot systems.Neurocomputing,2015,163(9):47-55.
[47]LOPE D J,MARAVALL D,QUINONEZ Y.Response threshold models and stochastic learning automata for self-coordination of heterogeneous multi-task distribution in multi-robot systems.Robotics and Autonomous Systems,2013,61(7):714-720.
[48]杨文.UCL计算机系教授汪军:如何进行大规模多智体强化学习.https://www.leiphone.com/news/201707/5FqArxzG82upR2i2.html,2017.
[49]KURDI H A,ALOBOUD E,ALALWAN M,et al.Autonomous task allocation for multi-UAV systems based on the locust elastic behavior.Applied Soft Computing,2018,71(10):110-126.
[50]ZHEN Z,XING D,GAO C.Cooperative search-attack mission planning for multi-UAV based on intelligent self-organized algorithm.Aerospace Science and Technology,2018,76(5):402-411.
[51]TRAN L,CROSS C,MONTAGUE G,et al.Reinforcement learning with autonomous small unmanned aerial vehicles in cluttered environments.AIAA Aviation Technology,Integration,and Operations Conference.Dallas:AIAA,2015:2899-2917.
[52]YUKE Z,ROOZBEH M,ERIC K,et al.Target-driven visual navigation in indoor scenes using deep reinforcement learning.IEEEInternational Conference on Robotics and Automation.Singapore:IEEE,2017:3357-3364.
[53]MNIH V,BADIA A P,MIRZA M,et al.Asynchronous methods for deep reinforcement learning.Proceedings of the International Conference on Machine Learning.New York:IEEE,2016:1928-1937.
[54]KIM I,SHIN S,WU J,et al.Obstacle avoidance path planning for uav using reinforcement learning under simulated environment.IASER 3rd International Conference on Electronics,Electrical Engineering,Computer Science.Okinawa:IEEE,2017:34-36.
[55]CHRISTOPHER J C H W,PETER D.Q-learning.Machine Learning,1992,8(3/4):279-292.
[56]LI S,LIU T,ZHANG C,et al.Learning unmanned aerial vehicle control for autonomous target following.ArXiv Preprint.2017.arX-iv:1709.08233.
[57]TIMOTHY P L,JONATHAN J H,ALEXANDER P,et al.Continuous control with deep reinforcement learning.ArXiv Preprint.2015.arXiv:1509.02971.
[58]POLVARA R,PATACCHIOLA M,SHARMA S,et al.Autonomous quadrotor landing using deep reinforcement learning.ArXiv Preprint.2017.arXiv:1709.03339.
[59]VAN H H,GUEZ A,SLIVER D.Deep reinforcement learning with double Q-learning.Proceedings of the 30th AAAI Conference on Artificial Intelligence.Phoenix:AAAI,2016:1813-1819.
[60]IMANBERDIYEV N,FU C,KAYACAN E,et al.Autonomous navigation of UAV by using real-time model-based reinforcement learning.Proceedings of the 14th International Conference on Control,Automation,Robotics and Vision.Phuket:IEEE,2016:1-6.
[61]HESTER T,STONE P.Texplore:real-time sample-efficient reinforcement learning for robots.Machine Learning,2013,90(3):385-429.
[62]CHEN Y F,LIU M,EVERETT M,et al.Decentralized noncommunicating multiagent collision avoidance with deep reinforcement learning.IEEE International Conference on Robotics and Automation.Singapore:IEEE,2017:285-292.
[63]CHEN Y F,EVERETT M,LIU M,et al.Socially aware motion planning with deep reinforcement learning.ArXiv Preprint.2017.arXiv:1703.08862.
[64]LONG P,FAN T,LIOA X,et al.Towards optimally decentralized multi-robot collision avoidance via deep reinforcement learning.ArXiv Preprint.2017.ar Xiv:1709.10082.
[65]FAN Bangkui,ZHANG Ruiyu.UAV system and artificial intelligence.Journal of Wuhan University:Information Science Edition,2017,42(11):1523-1529.(樊邦奎,张瑞雨.无人机系统与人工智能.武汉大学学报·信息科学版,2017,42(11):1523-1529.)
[66]JANG J S R.Self-learning fuzzy controllers based on temporal backpropagation.IEEE Transactions on Neural Networks,1992,3(5):714-723.
[67]NGUYEN D H,WIDROW B.Neural networks for self-learning control systems.IEEE Control Systems Magazine,1990,10(3):18-23.
[68]CHIANG C K,CHUNG H Y,LIN J J.A self-learning fuzzy logic controller using genetic algorithms with reinforcements.IEEETransactions on Fuzzy Systems,1997,5(3):460-467.
[69]SUTTON R S,BARTO A G.Reinforcement Learning:An Introduction.Cambridge:MIT Press,1998.
[70]LIU Derong,LI Hongliang,WANG Ding.Data-based self-learning optimization control.Journal of Automation,2013,39(11):1858-1870.(刘德荣,李宏亮,王鼎.基于数据的自学习优化控制:研究进展与展望.自动化学报,2013,39(11):1858-1870.)
[71]CLAEYS M,LATRE S,FAMAEY J,et al.Design and evaluation of a self-learning HTTP adaptive video streaming client.IEEE Communications Letters,2014,18(4):716-719.
[72]WEI Q,LIU D,YANG X.Infinite horizon self-learning optimal control of nonaffine discrete-time nonlinear systems.IEEE Transactions on Neural Networks and Learning Systems,2015,26(4):866-879.
[73]RUSSELL S J,NORVIG P.Artificial Intelligence:A Modern Approach.Malaysia:Pearson Education Limited,2016.
[74]GAUDET B,LINARES R,FURFARO R.Deep reinforcement learning for six degree-of-freedom planetary powered descent and landing.ArXiv Preprint.2018,arXiv:1810.08719.
[75]KOCH W,MANCUSO R,WEST R,et al.Reinforcement learning for UAV attitude control.ArXiv Preprint.2018.arXiv:1804.04154.
[76]SU Z,ZHOU M,HAN F,et al.Attitude control of underwater glider combined reinforcement learning with active disturbance rejection control.Journal of Marine Science and Technology,2018,DOI:10.1007/s0077.
[77]WILLIS S,IZZO D,HENNES D.Reinforcement learning for spacecraft maneuvering near small bodies.AAS/AIAA Space Flight Mechanics Meeting.Napa:AIAA,2016:14-18.
[78]TURKOGLU K,SUN F.Reinforcement learning based continuoustime on-line spacecraft dynamics control:case study of nasa spheres spacecraft.AIAA Guidance,Navigation,and Control Conference.Florida:AIAA,2018:8-12.
[79]ABBEEL P,COATES A,NG A Y.Autonomous helicopter aerobatics through apprenticeship learning.The International Journal of Robotics Research,2010,29(13):1608-1639.
[80]ABBEEL P.Apprenticeship learning and reinforcement learning with application to robotic control.California:Stanford University,2008.
[81]HWANGBO J,SA I,SIEGWART R,et al.Control of a quadrotor with reinforcement learning.IEEE Robotics and Automation Letters,2017,2(4):2096-2103.
[82]WU H,SONG S,YOU K,et al.Depth control of model-free AUVs via reinforcement learning.IEEE Transactions on Systems,Man,and Cybernetics:Systems,2018,DOI:10.1109/TSMC.2017.2785794.
[83]CUI R,YANG C,LI Y,et al.Adaptive neural network control of AUVs with control input nonlinearities using reinforcement learning.IEEE Transactions on Systems,Man,and Cybernetics:Systems,2017,47(6):1019-1029.
[84]PALUNKO I,FAUST A,CRUZ P,et al.A reinforcement learning approach towards autonomous suspended load manipulation using aerial robots.Proceedings of the IEEE International Conference on Robotics and Automation.Karlsruhe:IEEE,2013:4881-4886.
[85]FAUST A,PALUNKO I,CRUZ P,et al.Learning swing-free trajectories for UAVs with a suspended load.Proceedings of the IEEEInternational Conference on Robotics and Automation.Karlsruhe:IEEE,2013:4902-4909.
[86]FAUST A,PALUNKO I,CRUZ P,et al.Automated aerial suspended cargo delivery through reinforcement learning.Artificial Intelligence,2017,247(7):381-398.
[87]KAHN G,VILLAFLOR A,PONG V,et al.Uncertainty-aware reinforcement learning for collision avoidance.ArXiv Preprint.2017,arXiv:1702.01182.
[88]ZHANG T,KAHN G,LEVIN S,et al.Learning deep control policies for autonomous aerial vehicles with mpc-guided policy search.Proceedings of the IEEE International Conference on Robotics and Automation.Stockholm:IEEE,2016:528-535.
[89]ZHAO F,ZENG Y,WANG G,et al.A brain-inspired decision making model based on top-down biasing of prefrontal cortex to basal ganglia and its application in autonomous UAV explorations.Cognitive Computation,2018,10(2):296-306.
[90]CHENG Y,ZHANG W.Concise deep reinforcement learning obstacle avoidance for underactuated unmanned marine vessels.Neurocomputing,2018,272(1):63-73.
[91]MA Z,WANG C,NIU Y,et al.A saliency-based reinforcement learning approach for a UAV to avoid flying obstacles.Robotics and Autonomous Systems,2018,100(2):108-118.
[92]HUNG S M,GIVIGI S N.A Q-learning approach to flocking with UAVs in a stochastic environment.IEEE Transactions on Cybernetics,2017,47(1):186-197.
[93]XU H,CARRILLO L R G.Fast reinforcement learning based distributed optimal flocking control and network co-design for uncertain networked multi-UAV system.Proceedings of the SPIE 10195.California:Unmanned Systems Technology XIX,2017:1019511-1-1019511-9.
[94]KIUMARSI B,VANVOUDAKIS K G,MODARES H,et al.Optimal and autonomous control using reinforcement learning:A survey.IEEE Transactions on Neural Networks and Learning Systems,2018,29(6):2042-2062.
[95]KIUMARSI B,LEWIS F L.Output synchronization of heterogeneous discrete-time systems:A model-free optimal approach.Automatica,2017,84(10):86-94.
[96]LI J,MODARES H,CAHI T.Off-policy reinforcement learning for synchronization in multiagent graphical games.IEEE Transactions on Neural Networks and Learning Systems,2017,28(10):2434-2445.
[97]JIANG Y,FAN J,CHAI T,et al.Tracking control for linear discretetime networked control systems with unknown dynamics and dropout.IEEE Transactions on Neural Networks and Learning Systems,2018,29(6):2042-2062.
[98]JIANG H,ZHANG H,LUO Y,et al.Neural-network-based robust control schemes for nonlinear multiplayer systems with uncertainties via adaptive dynamic programming.IEEE Transactions on Systems,Man,and Cybernetics:Systems,2018,DOI:10.1109/TSM-C.2018.2810117.
[99]JIANG H,ZHANG H,XIAO G,et al.Data-based approximate optimal control for nonzero-sum games of multi-player systems using adaptive dynamic programming.Neurocomputing,2018,275(1):192-199.
[100]WANG D,LIU D,ZHANG Y,et al.Neural network robust tracking control with adaptive critic framework for uncertain nonlinear systems.Neural Networks,2018,97(1):11-18.
[101]LUO B,LIU D,HUANG T,et al.Multi-step heuristic dynamic programming for optimal control of nonlinear discrete-time systems.Information Sciences,2017,411(10):66-83.
[102]GAO W,HUANG M,JIANG Z,et al.Sampled-data-based adaptive optimal output-feedback control of a 2-degree-of-freedom helicopter.IET Control Theory&Applications,2016,10(12):1440-1447.
[103]GAO W N,JIANG Z P.Learning-based adaptive optimal tracking control of strict-feedback nonlinear systems.IEEE Transactions on Neural Networks and Learning Systems,2018,29(6):2614-2624.
[104]ZUO S,SONG Y,LEWIS F L,et al.Optimal robust output containment of unknown heterogeneous multiagent system using off-policy reinforcement learning.IEEE Transactions on Cybernetics,2018,29(6):2042-2062.
[105]SONG Y D,LEWIS F L,POLYCARPOU M,et al.Guest editorial special issue on new developments in neural network structures for signal processing,autonomous decision,and adaptive control.IEEE Transactions on Neural Networks and Learning Systems,2017,28(3):494-499.
[106]WATKINS J C H C,DAYAN P.Genetic fuzzy based artificial intelligence for unmanned combat aerial vehicle control in simulated air combat missions.Journal of Defense Management,2016,6(144):2167-0374.
[107]LI B,ZHANG X,FANG Y,et al.Visual servoing of wheeled mobile robots without desired images.IEEE Transactions on Cybernetics,2018,DOI:10.1109/TCYB.2018.2828333.
[108]CHEN J,ZHAGN X,XIN B,et al.Coordination between unmanned aerial and ground vehicles:a taxonomy and optimization perspective.IEEE Transactions on Cybernetics,2016,46(4):959-972.
[109]HOU Z S,WANG Z.From model-based control to data-driven control:Survey,classification and perspective.Information Sciences,2013,235(6):3-35.
[110]TIAN Taotao,HOU Zhongsheng,LIU Shida,et al.Unmanned vehicle lateral control method based on model-free adaptive control.Acta Automatica Sinica,2017,43(11):1931-1940.(田涛涛,侯忠生,刘世达,等.基于无模型自适应控制的无人驾驶汽车横向控制方法.自动化学报,2017,43(11):1931-1940.)
[111]XU X,CHEN H,LIAN C,et al.Learning-based predictive control for discrete-time nonlinear systems with stochastic disturbances.IEEE Transactions on Neural Networks and Learning Systems,2018,29(12):6202-6213.
[112]DOU R,DUAN H.Pigeon inspired optimization approach to model prediction control for unmanned air vehicles.Aircraft Engineering and Aerospace Technology:An International Journal,2016,88(1):108-116.
[113]ABBASPOUR A,ABOUTALEBI P,YEN K K,et al.Neural adaptive observer-based sensor and actuator fault detection in nonlinear systems:Application in UAV.ISA Transactions,2017,67(3):317-329.
[114]CHEN M,SHI P,LIM C C.Adaptive neural fault-tolerant control of a 3-DOF model helicopter system.IEEE Transactions on Systems,Man,and Cybernetics:Systems,2016,46(2):260-270.
[115]JIA F,LEI Y,GUO L,et al.A neural network constructed by deep learning technique and its application to intelligent fault diagnosis of machines.Neurocomputing,2018,272(1):619-628.
[116]HE M,HE D.Deep learning based approach for bearing fault diagnosis.IEEE Transactions on Industry Applications,2017,53(3):3057-3065.
[117]HUNDAM K,CONSTANTINOU V,LAPORTE C,et al.Detecting spacecraft anomalies using lstms and nonparametric dynamic thresholding.ArXiv Preprint.2018,arXiv:1802.04431.
[118]MA J,NI S,XIE W,et al.Deep auto-encoder observer multiplemodel fast aircraft actuator fault diagnosis algorithm.International Journal of Control Automation&Systems,2017,15(11):1-10.
[119]GUO D,ZHOGN M,JI H,et al.A hybrid feature model and deep learning based fault diagnosis for unmanned aerial vehicle sensors.Neurocomputing,2018,319(11):155-163.
[120]CHE C,WANG H,NI X,et al.Fault fusion diagnosis of aero-engine based on deep learning.Journal of Beijing University of Aeronautics and Astronautics,2018,44(3):621-628.(车畅畅,王华伟,倪晓梅,等.基于深度学习的航空发动机故障融合诊断.北京航空航天大学学报,2018,44(3):621-628.)
[121]FANG H,SHI H,DONG Y,et al.Spacecraft power system fault diagnosis based on DNN.Prognostics and System Health Management Conference.Harbin:IEEE,2017:1-5.
[122]LU H,LI Y,MU S,et al.Motor anomaly detection for unmanned aerial vehicles using reinforcement learning.IEEE Internet of Things Journal,2018,5(4):2315-2322.
[123]XIE C H,YANG G H.Data-based fault-tolerant control for affine nonlinear systems with actuator faults.ISA Transactions,2016,64(9):285-292.
[124]KIM D,OH G,SEO Y,et al.Reinforcement learning-based optimal flat spin recovery for unmanned aerial vehicle.Journal of Guidance,Control,and Dynamics,2016,40(4):1-8.
[125]KARRAY F,ALEMZADEH M,SALEH J A,et al.Humancomputer interaction:overview on state of the art.International Journal on Smart Sensing and Intelligent Systems,2008,1(1):137-159.
[126]袁成.DARPA OFFSET项目最新进展.http://www.dsti.net/Information/News/109091,2018.
[127]KARAVAS G K,ARTEMIADIS P.On the effect of swarm collective behavior on human perception:towards brain-swarm interfaces..Proceedings of the IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems.San Diego:IEEE,2015:172-177.
[128]GAO S,WANG Y,GAO X,et al.Visual and auditory braincomputer interfaces.IEEE Transactions on Biomedical Engineering,2014,61(5):1436-1447.
[129]王晓易.清华大学:智能机器狗表演“意识流”足球.http://news.163.com/06/0615/07/2JL2JIMD00011229.html,2006.
[130]LONG J,LI Y,WANG H,et al.A hybrid brain computer interface to control the direction and speed of a simulated or real wheelchair.IEEE Transactions on Neural Systems&Rehabilitation Engineering,2012,20(5):720-729.
[131]MING D,WANG K,HE F,et al.Study on physiological information detection and application evoked by motor imagery:Review and prospect.Chinese Journal of Scientific Instrument,2014,35(9):1921-1931.
[132]YU Y,ZHOU Z,YIN E,et al.A P300-based brain-computer interface for chinese character input.International Journal of HumanComputer Interaction,2016,32(11):878-884.
[133]LU Y,HU Y,LIU R,et al.The design of simulation vehicle system controlled by multichannel EEG based on imaginary movements.Proceedings of the 35th Chinese Control Conference.Chengdu:IEEE,2016:4976-4981.
[134]KARRAY F,ALEMZADEH M,SALEH J A,et al.Humancomputer interaction:overview on state of the art.International Journal on Smart Sensing and Intelligent Systems,2008,1(1):137-159.
[135]AL-KAFF A,MARTIN D,GARCIA F,et al.Survey of computer vision algorithms and applications for unmanned aerial vehicles.Expert Systems with Applications,2018,92(2):447-463.
[136]CARRIO A,SAMPERDRO C,RODRIGUEZ R A,et al.A review of deep learning methods and applications for unmanned aerial vehicles.Journal of Sensors,2017,DOI:10.1155/2017/3296874.
[137]KIM I,MORRISON J R.Learning based framework for joint task allocation and system design in stochastic multi-UAV systems.2018International Conference on Unmanned Aircraft Systems.Texas:IEEE,2018:324-334.
[138]JIANG Y.A survey of task allocation and load balancing in distributed systems.IEEE Transactions on Parallel and Distributed Systems,2016,27(2):585-599.
[139]LOWE R,WU Y,TAMAR A,et al.Multi-agent actor-critic for mixed cooperative-competitive environments.Advances in Neural Information Processing Systems 30.Long Beach:Curran Associates,2017:6382-6393.
[140]HONORABLE K M F,MARY J M.Unmanned systems integrated roadmap FY 2011-2036.US:Office of the Secretary of Defense,2011,
[141]HADAEGH F Y,CHUNG S J,MANOHARA H M.On development of 100-gram-class spacecraft for swarm applications.IEEESystems Journal,2016,10(2):673-684.
[142]CHUNG S J,PARANJAPE A A,DAMES P,et al.A survey on aerial swarm robotics.IEEE Transactions on Robotics,2018,34(4):837-855.
[143]EVERETT M,CHEN Y F,HOW J P.Motion planning among dynamic,decision-making agents with deep reinforcement learning.ArXiv Preprint.2018,arXiv:1805.01956.
[144]WANG J X,KURTH N Z,TIRUMALA D,et al.Learning to reinforcement learn.ArXiv Preprint.2016,arXiv:1611.05763.
[145]DUAN Y,SCHULMAN J,CHEN X,et al.Rl2:Fast reinforcement learning via slow reinforcement learning.ArXiv Preprint.2016,arXiv:1611.02779.
[146]FINN C,ABBEEL P,LEVIN S.Model-agnostic meta-learning for fast adaptation of deep networks.ArXiv Preprint.2017,arXiv:1703.03400.
[147]MIOTTO R,WANG F,WANG S,et al.Deep learning for healthcare:review,opportunities and challenges.Briefings in Bioinformatics,2017,18(6):1236-1246.
[148]ZHAO G,ZHAGN G,GE Q,et al.Research advances in fault diagnosis and prognostic based on deep learning.Prognostics and System Health Management Conference.Chengdu:IEEE,2016:1-6.
[149]LEI Y,JIA F,LIN J,et al.An intelligent fault diagnosis method using unsupervised feature learning towards mechanical big data.IEEE Transactions on Industrial Electronics,2016,63(5):3137-3147.
[150]LIU R,YANG B,ZIO E,et al.Artificial intelligence for fault diagnosis of rotating machinery:A review.Mechanical Systems and Signal Processing,2018,108(8):33-47.
[151]NIKFARJAM A,SARKER A,O’CONNOR K,et al.Pharmacovigilance from social media:mining adverse drug reaction mentions using sequence labeling with word embedding cluster features.Journal of the American Medical Informatics Association,2015,22(3):671-681.
[152]CROWLEY J.Put that there:20 years of research on multimodal interaction.Proceedings of the 2018 on International Conference on Multimodal Interaction.Colorado:ACM,2018:4-4.
[153]WANG Dangxiao,ZHENG Yilei,LI Teng,et al.Multi-modal human-machine interaction for human intelligence augmentation.Scientia Sinica Informationis,2018,48(4):449-465.(王党校,郑一磊,李腾,等.面向人类智能增强的多模态人机交互.中国科学:信息科学,2018,48(4):449-465.)
[2]ZENG Yi,LIU Chenglin,TAN Tieniu.Retrospect and outlook of brain-inpired intelligence research.Chinese Journal of Computers,2016,1(1):212-222.(曾毅,刘成林,谭铁牛.类脑智能研究的回顾与展望.计算机学报,2016,1(1):212-222.)
[3]XU Bo,LIU Chenglin,ZENG Yi.Research status and developments of brain-inspired intelligence.Bulletin of Chinese Academy of Sciences,2016,31(7):793-802.(徐波,刘成林,曾毅.类脑智能研究现状与发展思考.中国科学院院刊,2016,31(7):793-802.)
[4]CAMBONE A S,KRIEG J K,PACE P,et al.Unmanned Aircraft Systems Roadmap 2005-2030.US:Office of the Secretary of Defense.2005.
[5]SHU Z,JIA Q,LI X,et al.An ooda loop-based function network modeling and simulation evaluation method for combat system-ofsystems.Theory,Methodology,Tools and Applications for Modeling and Simulation of Complex Systems.Singapore:Springer,2016:393-402.
[6]LECUN Y,BENGIO Y,HINTON G.Deep learning.Nature,2015,521(7553):436-444.
[7]GIRSHICK R,DONAHUE J,DARREL T,et al.Rich feature hierarchies for accurate object detection and semantic segmentation.Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Columbus:IEEE,2014:580-587.
[8]REN S,HE K,GIRSHICK R,et al.Faster R-CNN:towards realtime object detection with region proposal networks.Advances in Neural Information Processing Systems 28.Montreal:Springer,2015:91-99.
[9]REDMON J,DIVVALA S,GIRSHICK R,et al.You only look once:unified,real-time object detection.Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Lasvegas:IEEE,2016:779-788.
[10]GIRSHICK R,DONAHUE J,DARREL T,et al.Rich feature hierarchies for accurate object detection and semantic segmentation.Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Boston:IEEE,2014:580-587.
[11]LEE J,WANG J,CRANDALL D,et al.Real-time,cloud-based object detection for unmanned aerial vehicles.IEEE International Conference on Robotic Computing.Taichung:IEEE,2017:36-43.
[12]LIU W,ANGUELOV D,ERHAN D,et al.SSD:Single shot multibox detector.European Conference on Computer Vision.Cham:Springer,2016:21-37.
[13]ZHOU B,LAPEDRIZA A,XIAO J,et al.Learning deep features for scene recognition using places database.International Conference on Neural Information Processing Systems.Montreal:Springer,2014:487-495.
[14]PENATTI O A B,NOGUEIRA K,SANTOS J A D.Do deep features generalize from everyday objects to remote sensing and aerial scenes domains.Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Boston:IEEE,2015:44-51.
[15]HU F,XIA G S,HU J,et al.Transferring deep convolutional neural networks for the scene classification of high-resolution remote sensing imagery.Remote Sensing,2015,7(11):14680-14707.
[16]AMIR G,VASSILIS A.Selective unsupervised feature learning with convolutional neural network(S-CNN).Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Mexico:IEEE,2016:2486-2490.
[17]CHEN Y,ZHAO D,LV L,et al.Multi-task learning for dangerous object detection in autonomous driving.Information Sciences,2018,432(3):559-571.
[18]GIUSTI A,GUZZI J,DAN C C,et al.A machine learning approach to visual perception of forest trails for mobile robots.IEEE Robotics and Automation Letters,2016,1(2):661-667.
[19]HUNG C,ZHE X,SUKKARIEH S.Feature learning based approach for weed classification using high resolution aerial images from a digital camera mounted on a UAV.Remote Sensing,2014,6(12):12037-12054.
[20]CHEN S W,SKANDAN S S,DCUNHA S,et al.Counting apples and oranges with deep learning:a data driven approach.IEEERobotics&Automation Letters,2017,2(2):781-788.
[21]LI W,FU H,YU L,et al.Deep learning based oil palm tree detection and counting for high-resolution remote sensing images.Remote Sensing,2016,9(1):22-31.
[22]KRIZHEVSKY A,SUTSKEVER I,HINTON G E.ImageNet classification with deep convolutional neural networks.International Conference on Neural Information Processing Systems.Nevada:Springer,2012:1097-1105.
[23]KIM H,KIM D,JUNG S,et al.Development of a UAV-type jellyfish monitoring system using deep learning.International Conference on Ubiquitous Robots and Ambient Intelligence.Xi’an:IEEE,2015:495-497.
[24]BEJIGA M,ZEGGADA A,NOUFFIDJ A,et al.A convolutional neural network approach for assisting avalanche search and rescue operations with UAV imagery.Remote Sensing,2017,9(2):100-108.
[25]SAWARKAR A,CHAUDHARI V,CHAVAN R,et al.HMD visionbased teleoperating UGV and UAV for hostile environment using deep learning.ArXiv Preprint.2016.arXiv:1609.04147.
[26]KENDALL A,GRIMES M,CIPOLLA R.PoseNet:a convolutional network for real-time 6-DOF camera relocalization.IEEE International Conference on Computer Vision.Santiago:IEEE,2015:2938-2946.
[27]YI K M,TRULLS E,LEPETIT V,et al.LIFT:learned invariant feature transform.European Conference on Computer Vision.Cham:Springer,2016:467-483.
[28]DETONE D,MALISIEWICZ T,RABINOVICH A.Toward geometric deep SLAM.ArXiv Preprint.2017.arXiv:1707.07410.
[29]ZHOU T,BROWN M,SNAVELY N,et al.Unsupervised learning of depth and ego-motion from video.Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Hawaii:IEEE,2017:6612-6619.
[30]TATENO K,TOMBARI F,LAINA I,et al.CNN-SLAM:real-time dense monocular SLAM with learned depth prediction.Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Hawaii:IEEE,2017:6565-6574.
[31]ZHAO Zonggui,XIONG Zhaohua,WANG Ke,et al.Theory,Methodology,Tools and Applications for Modeling and Simulation of Complex Systems.Beijing:National Defense Industry Press,2012.(赵宗贵,熊朝华,王珂,等.信息融合概念方法与应用.北京:国防工业出版社,2012.)
[32]ZHU Feng,HU Xiaofeng.Survey and research progress of battlefield situation assessment based on deep learning.Military Operations and Systems Engineering,2016,30(3):22-27.(朱丰,胡晓峰.基于深度学习的战场态势评估综述与研究展望.军事运筹与系统工程,2016,30(3):22-27.)
[33]SILVER D,HUANG A,MADDISON C J,et al.Mastering the game of go with deep neural networks and tree search.Nature,2016,529(7587):484-489.
[34]LI C,CAO M,TIAN L.Situation assessment approach based on a hierarchic multi-timescale bayesian network.International Conference on Information Science and Control Engineering.Shanghai:IEEE,2015:911-915.
[35]DAS S,GREY R,GONSALVES P.Situation assessment via Bayesian belief networks.Proceedings of the Fifth International Conference on Information Fusion.Annapolis:IEEE,2002:664-671.
[36]MIRMOEINI F,KRISHNAMURTHY V.Reconfigurable Bayesian networks for hierarchical multi-stage situation assessment in battlespace.Conference Record of the Thirty-Ninth Asilomar Conference on Signals,Pacific Grove:IEEE,2005:104-108.
[37]LUO L,CHAKRABORTY N,SYCARA K.Provably-good distributed algorithm for constrained multi-robot task assignment for grouped tasks.IEEE Transactions on Robotics,2015,31(1):19-30.
[38]LEE D H,ZAHEER S A,KIM J H.A Resource-oriented,decentralized auction algorithm for multirobot task allocation.IEEE Transactions on Automation Science&Engineering,2015,12(4):1469-1481
[39]JANG I,SHIN H S,TSOURDOS A.Anonymous hedonic game for task allocation in a large-scale multiple agent system.ArXiv Preprint.2017.arXiv:1711.06871.
[40]JANG I,SHIN H S,TSOURDOS A,et al.An integrated decisionmaking framework of a heterogeneous aerial robotic swarm for cooperative tasks with minimum requirements.Proceedings of the Institution of Mechanical Engineers,Part G:Journal of Aerospace Engineering,2018,DOI:10.1177/0954410018772622.
[41]JANG I,SHIN H S,TSOURDOS A.A comparative study of gametheoretical and markov-chain-based approaches to division of labour in a robotic swarm.IFAC-PapersOnLine,2018,51(12):62-68.
[42]MNIH V,KAVUKCUOGLU K,SILVER D,et al.Playing atari with deep reinforcement learning.ArXiv Preprint.2013.arXiv:1312.5602.
[43]MNIH V,KAVUKCUOGLU K,SILVER D,et al.Human-level control through deep reinforcement learning.Nature,2015,518(7540):529-533.
[44]WANG Chong.Research on distributed cooperative mission planning of earth observation satellite based on agent.Changsha:Military Operations and Systems Engineering,2011.(王冲.基于Agent的对地观测卫星分布式协同任务规划研究.长沙:国防科学技术大学,2011.)
[45]GURZONI J A,TONIDANDEL F,BIANCHI R A C.Market-based dynamic task allocation using heuristically accelerated reinforcement learning.Portuguese Conference on Artificial Intelligence.Berlin:Springer,2012:365-376.
[46]LOPE D J,MARAVALL D,QUINONEZ Y.Self-organizing techniques to improve the decentralized multi-task distribution in multirobot systems.Neurocomputing,2015,163(9):47-55.
[47]LOPE D J,MARAVALL D,QUINONEZ Y.Response threshold models and stochastic learning automata for self-coordination of heterogeneous multi-task distribution in multi-robot systems.Robotics and Autonomous Systems,2013,61(7):714-720.
[48]杨文.UCL计算机系教授汪军:如何进行大规模多智体强化学习.https://www.leiphone.com/news/201707/5FqArxzG82upR2i2.html,2017.
[49]KURDI H A,ALOBOUD E,ALALWAN M,et al.Autonomous task allocation for multi-UAV systems based on the locust elastic behavior.Applied Soft Computing,2018,71(10):110-126.
[50]ZHEN Z,XING D,GAO C.Cooperative search-attack mission planning for multi-UAV based on intelligent self-organized algorithm.Aerospace Science and Technology,2018,76(5):402-411.
[51]TRAN L,CROSS C,MONTAGUE G,et al.Reinforcement learning with autonomous small unmanned aerial vehicles in cluttered environments.AIAA Aviation Technology,Integration,and Operations Conference.Dallas:AIAA,2015:2899-2917.
[52]YUKE Z,ROOZBEH M,ERIC K,et al.Target-driven visual navigation in indoor scenes using deep reinforcement learning.IEEEInternational Conference on Robotics and Automation.Singapore:IEEE,2017:3357-3364.
[53]MNIH V,BADIA A P,MIRZA M,et al.Asynchronous methods for deep reinforcement learning.Proceedings of the International Conference on Machine Learning.New York:IEEE,2016:1928-1937.
[54]KIM I,SHIN S,WU J,et al.Obstacle avoidance path planning for uav using reinforcement learning under simulated environment.IASER 3rd International Conference on Electronics,Electrical Engineering,Computer Science.Okinawa:IEEE,2017:34-36.
[55]CHRISTOPHER J C H W,PETER D.Q-learning.Machine Learning,1992,8(3/4):279-292.
[56]LI S,LIU T,ZHANG C,et al.Learning unmanned aerial vehicle control for autonomous target following.ArXiv Preprint.2017.arX-iv:1709.08233.
[57]TIMOTHY P L,JONATHAN J H,ALEXANDER P,et al.Continuous control with deep reinforcement learning.ArXiv Preprint.2015.arXiv:1509.02971.
[58]POLVARA R,PATACCHIOLA M,SHARMA S,et al.Autonomous quadrotor landing using deep reinforcement learning.ArXiv Preprint.2017.arXiv:1709.03339.
[59]VAN H H,GUEZ A,SLIVER D.Deep reinforcement learning with double Q-learning.Proceedings of the 30th AAAI Conference on Artificial Intelligence.Phoenix:AAAI,2016:1813-1819.
[60]IMANBERDIYEV N,FU C,KAYACAN E,et al.Autonomous navigation of UAV by using real-time model-based reinforcement learning.Proceedings of the 14th International Conference on Control,Automation,Robotics and Vision.Phuket:IEEE,2016:1-6.
[61]HESTER T,STONE P.Texplore:real-time sample-efficient reinforcement learning for robots.Machine Learning,2013,90(3):385-429.
[62]CHEN Y F,LIU M,EVERETT M,et al.Decentralized noncommunicating multiagent collision avoidance with deep reinforcement learning.IEEE International Conference on Robotics and Automation.Singapore:IEEE,2017:285-292.
[63]CHEN Y F,EVERETT M,LIU M,et al.Socially aware motion planning with deep reinforcement learning.ArXiv Preprint.2017.arXiv:1703.08862.
[64]LONG P,FAN T,LIOA X,et al.Towards optimally decentralized multi-robot collision avoidance via deep reinforcement learning.ArXiv Preprint.2017.ar Xiv:1709.10082.
[65]FAN Bangkui,ZHANG Ruiyu.UAV system and artificial intelligence.Journal of Wuhan University:Information Science Edition,2017,42(11):1523-1529.(樊邦奎,张瑞雨.无人机系统与人工智能.武汉大学学报·信息科学版,2017,42(11):1523-1529.)
[66]JANG J S R.Self-learning fuzzy controllers based on temporal backpropagation.IEEE Transactions on Neural Networks,1992,3(5):714-723.
[67]NGUYEN D H,WIDROW B.Neural networks for self-learning control systems.IEEE Control Systems Magazine,1990,10(3):18-23.
[68]CHIANG C K,CHUNG H Y,LIN J J.A self-learning fuzzy logic controller using genetic algorithms with reinforcements.IEEETransactions on Fuzzy Systems,1997,5(3):460-467.
[69]SUTTON R S,BARTO A G.Reinforcement Learning:An Introduction.Cambridge:MIT Press,1998.
[70]LIU Derong,LI Hongliang,WANG Ding.Data-based self-learning optimization control.Journal of Automation,2013,39(11):1858-1870.(刘德荣,李宏亮,王鼎.基于数据的自学习优化控制:研究进展与展望.自动化学报,2013,39(11):1858-1870.)
[71]CLAEYS M,LATRE S,FAMAEY J,et al.Design and evaluation of a self-learning HTTP adaptive video streaming client.IEEE Communications Letters,2014,18(4):716-719.
[72]WEI Q,LIU D,YANG X.Infinite horizon self-learning optimal control of nonaffine discrete-time nonlinear systems.IEEE Transactions on Neural Networks and Learning Systems,2015,26(4):866-879.
[73]RUSSELL S J,NORVIG P.Artificial Intelligence:A Modern Approach.Malaysia:Pearson Education Limited,2016.
[74]GAUDET B,LINARES R,FURFARO R.Deep reinforcement learning for six degree-of-freedom planetary powered descent and landing.ArXiv Preprint.2018,arXiv:1810.08719.
[75]KOCH W,MANCUSO R,WEST R,et al.Reinforcement learning for UAV attitude control.ArXiv Preprint.2018.arXiv:1804.04154.
[76]SU Z,ZHOU M,HAN F,et al.Attitude control of underwater glider combined reinforcement learning with active disturbance rejection control.Journal of Marine Science and Technology,2018,DOI:10.1007/s0077.
[77]WILLIS S,IZZO D,HENNES D.Reinforcement learning for spacecraft maneuvering near small bodies.AAS/AIAA Space Flight Mechanics Meeting.Napa:AIAA,2016:14-18.
[78]TURKOGLU K,SUN F.Reinforcement learning based continuoustime on-line spacecraft dynamics control:case study of nasa spheres spacecraft.AIAA Guidance,Navigation,and Control Conference.Florida:AIAA,2018:8-12.
[79]ABBEEL P,COATES A,NG A Y.Autonomous helicopter aerobatics through apprenticeship learning.The International Journal of Robotics Research,2010,29(13):1608-1639.
[80]ABBEEL P.Apprenticeship learning and reinforcement learning with application to robotic control.California:Stanford University,2008.
[81]HWANGBO J,SA I,SIEGWART R,et al.Control of a quadrotor with reinforcement learning.IEEE Robotics and Automation Letters,2017,2(4):2096-2103.
[82]WU H,SONG S,YOU K,et al.Depth control of model-free AUVs via reinforcement learning.IEEE Transactions on Systems,Man,and Cybernetics:Systems,2018,DOI:10.1109/TSMC.2017.2785794.
[83]CUI R,YANG C,LI Y,et al.Adaptive neural network control of AUVs with control input nonlinearities using reinforcement learning.IEEE Transactions on Systems,Man,and Cybernetics:Systems,2017,47(6):1019-1029.
[84]PALUNKO I,FAUST A,CRUZ P,et al.A reinforcement learning approach towards autonomous suspended load manipulation using aerial robots.Proceedings of the IEEE International Conference on Robotics and Automation.Karlsruhe:IEEE,2013:4881-4886.
[85]FAUST A,PALUNKO I,CRUZ P,et al.Learning swing-free trajectories for UAVs with a suspended load.Proceedings of the IEEEInternational Conference on Robotics and Automation.Karlsruhe:IEEE,2013:4902-4909.
[86]FAUST A,PALUNKO I,CRUZ P,et al.Automated aerial suspended cargo delivery through reinforcement learning.Artificial Intelligence,2017,247(7):381-398.
[87]KAHN G,VILLAFLOR A,PONG V,et al.Uncertainty-aware reinforcement learning for collision avoidance.ArXiv Preprint.2017,arXiv:1702.01182.
[88]ZHANG T,KAHN G,LEVIN S,et al.Learning deep control policies for autonomous aerial vehicles with mpc-guided policy search.Proceedings of the IEEE International Conference on Robotics and Automation.Stockholm:IEEE,2016:528-535.
[89]ZHAO F,ZENG Y,WANG G,et al.A brain-inspired decision making model based on top-down biasing of prefrontal cortex to basal ganglia and its application in autonomous UAV explorations.Cognitive Computation,2018,10(2):296-306.
[90]CHENG Y,ZHANG W.Concise deep reinforcement learning obstacle avoidance for underactuated unmanned marine vessels.Neurocomputing,2018,272(1):63-73.
[91]MA Z,WANG C,NIU Y,et al.A saliency-based reinforcement learning approach for a UAV to avoid flying obstacles.Robotics and Autonomous Systems,2018,100(2):108-118.
[92]HUNG S M,GIVIGI S N.A Q-learning approach to flocking with UAVs in a stochastic environment.IEEE Transactions on Cybernetics,2017,47(1):186-197.
[93]XU H,CARRILLO L R G.Fast reinforcement learning based distributed optimal flocking control and network co-design for uncertain networked multi-UAV system.Proceedings of the SPIE 10195.California:Unmanned Systems Technology XIX,2017:1019511-1-1019511-9.
[94]KIUMARSI B,VANVOUDAKIS K G,MODARES H,et al.Optimal and autonomous control using reinforcement learning:A survey.IEEE Transactions on Neural Networks and Learning Systems,2018,29(6):2042-2062.
[95]KIUMARSI B,LEWIS F L.Output synchronization of heterogeneous discrete-time systems:A model-free optimal approach.Automatica,2017,84(10):86-94.
[96]LI J,MODARES H,CAHI T.Off-policy reinforcement learning for synchronization in multiagent graphical games.IEEE Transactions on Neural Networks and Learning Systems,2017,28(10):2434-2445.
[97]JIANG Y,FAN J,CHAI T,et al.Tracking control for linear discretetime networked control systems with unknown dynamics and dropout.IEEE Transactions on Neural Networks and Learning Systems,2018,29(6):2042-2062.
[98]JIANG H,ZHANG H,LUO Y,et al.Neural-network-based robust control schemes for nonlinear multiplayer systems with uncertainties via adaptive dynamic programming.IEEE Transactions on Systems,Man,and Cybernetics:Systems,2018,DOI:10.1109/TSM-C.2018.2810117.
[99]JIANG H,ZHANG H,XIAO G,et al.Data-based approximate optimal control for nonzero-sum games of multi-player systems using adaptive dynamic programming.Neurocomputing,2018,275(1):192-199.
[100]WANG D,LIU D,ZHANG Y,et al.Neural network robust tracking control with adaptive critic framework for uncertain nonlinear systems.Neural Networks,2018,97(1):11-18.
[101]LUO B,LIU D,HUANG T,et al.Multi-step heuristic dynamic programming for optimal control of nonlinear discrete-time systems.Information Sciences,2017,411(10):66-83.
[102]GAO W,HUANG M,JIANG Z,et al.Sampled-data-based adaptive optimal output-feedback control of a 2-degree-of-freedom helicopter.IET Control Theory&Applications,2016,10(12):1440-1447.
[103]GAO W N,JIANG Z P.Learning-based adaptive optimal tracking control of strict-feedback nonlinear systems.IEEE Transactions on Neural Networks and Learning Systems,2018,29(6):2614-2624.
[104]ZUO S,SONG Y,LEWIS F L,et al.Optimal robust output containment of unknown heterogeneous multiagent system using off-policy reinforcement learning.IEEE Transactions on Cybernetics,2018,29(6):2042-2062.
[105]SONG Y D,LEWIS F L,POLYCARPOU M,et al.Guest editorial special issue on new developments in neural network structures for signal processing,autonomous decision,and adaptive control.IEEE Transactions on Neural Networks and Learning Systems,2017,28(3):494-499.
[106]WATKINS J C H C,DAYAN P.Genetic fuzzy based artificial intelligence for unmanned combat aerial vehicle control in simulated air combat missions.Journal of Defense Management,2016,6(144):2167-0374.
[107]LI B,ZHANG X,FANG Y,et al.Visual servoing of wheeled mobile robots without desired images.IEEE Transactions on Cybernetics,2018,DOI:10.1109/TCYB.2018.2828333.
[108]CHEN J,ZHAGN X,XIN B,et al.Coordination between unmanned aerial and ground vehicles:a taxonomy and optimization perspective.IEEE Transactions on Cybernetics,2016,46(4):959-972.
[109]HOU Z S,WANG Z.From model-based control to data-driven control:Survey,classification and perspective.Information Sciences,2013,235(6):3-35.
[110]TIAN Taotao,HOU Zhongsheng,LIU Shida,et al.Unmanned vehicle lateral control method based on model-free adaptive control.Acta Automatica Sinica,2017,43(11):1931-1940.(田涛涛,侯忠生,刘世达,等.基于无模型自适应控制的无人驾驶汽车横向控制方法.自动化学报,2017,43(11):1931-1940.)
[111]XU X,CHEN H,LIAN C,et al.Learning-based predictive control for discrete-time nonlinear systems with stochastic disturbances.IEEE Transactions on Neural Networks and Learning Systems,2018,29(12):6202-6213.
[112]DOU R,DUAN H.Pigeon inspired optimization approach to model prediction control for unmanned air vehicles.Aircraft Engineering and Aerospace Technology:An International Journal,2016,88(1):108-116.
[113]ABBASPOUR A,ABOUTALEBI P,YEN K K,et al.Neural adaptive observer-based sensor and actuator fault detection in nonlinear systems:Application in UAV.ISA Transactions,2017,67(3):317-329.
[114]CHEN M,SHI P,LIM C C.Adaptive neural fault-tolerant control of a 3-DOF model helicopter system.IEEE Transactions on Systems,Man,and Cybernetics:Systems,2016,46(2):260-270.
[115]JIA F,LEI Y,GUO L,et al.A neural network constructed by deep learning technique and its application to intelligent fault diagnosis of machines.Neurocomputing,2018,272(1):619-628.
[116]HE M,HE D.Deep learning based approach for bearing fault diagnosis.IEEE Transactions on Industry Applications,2017,53(3):3057-3065.
[117]HUNDAM K,CONSTANTINOU V,LAPORTE C,et al.Detecting spacecraft anomalies using lstms and nonparametric dynamic thresholding.ArXiv Preprint.2018,arXiv:1802.04431.
[118]MA J,NI S,XIE W,et al.Deep auto-encoder observer multiplemodel fast aircraft actuator fault diagnosis algorithm.International Journal of Control Automation&Systems,2017,15(11):1-10.
[119]GUO D,ZHOGN M,JI H,et al.A hybrid feature model and deep learning based fault diagnosis for unmanned aerial vehicle sensors.Neurocomputing,2018,319(11):155-163.
[120]CHE C,WANG H,NI X,et al.Fault fusion diagnosis of aero-engine based on deep learning.Journal of Beijing University of Aeronautics and Astronautics,2018,44(3):621-628.(车畅畅,王华伟,倪晓梅,等.基于深度学习的航空发动机故障融合诊断.北京航空航天大学学报,2018,44(3):621-628.)
[121]FANG H,SHI H,DONG Y,et al.Spacecraft power system fault diagnosis based on DNN.Prognostics and System Health Management Conference.Harbin:IEEE,2017:1-5.
[122]LU H,LI Y,MU S,et al.Motor anomaly detection for unmanned aerial vehicles using reinforcement learning.IEEE Internet of Things Journal,2018,5(4):2315-2322.
[123]XIE C H,YANG G H.Data-based fault-tolerant control for affine nonlinear systems with actuator faults.ISA Transactions,2016,64(9):285-292.
[124]KIM D,OH G,SEO Y,et al.Reinforcement learning-based optimal flat spin recovery for unmanned aerial vehicle.Journal of Guidance,Control,and Dynamics,2016,40(4):1-8.
[125]KARRAY F,ALEMZADEH M,SALEH J A,et al.Humancomputer interaction:overview on state of the art.International Journal on Smart Sensing and Intelligent Systems,2008,1(1):137-159.
[126]袁成.DARPA OFFSET项目最新进展.http://www.dsti.net/Information/News/109091,2018.
[127]KARAVAS G K,ARTEMIADIS P.On the effect of swarm collective behavior on human perception:towards brain-swarm interfaces..Proceedings of the IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems.San Diego:IEEE,2015:172-177.
[128]GAO S,WANG Y,GAO X,et al.Visual and auditory braincomputer interfaces.IEEE Transactions on Biomedical Engineering,2014,61(5):1436-1447.
[129]王晓易.清华大学:智能机器狗表演“意识流”足球.http://news.163.com/06/0615/07/2JL2JIMD00011229.html,2006.
[130]LONG J,LI Y,WANG H,et al.A hybrid brain computer interface to control the direction and speed of a simulated or real wheelchair.IEEE Transactions on Neural Systems&Rehabilitation Engineering,2012,20(5):720-729.
[131]MING D,WANG K,HE F,et al.Study on physiological information detection and application evoked by motor imagery:Review and prospect.Chinese Journal of Scientific Instrument,2014,35(9):1921-1931.
[132]YU Y,ZHOU Z,YIN E,et al.A P300-based brain-computer interface for chinese character input.International Journal of HumanComputer Interaction,2016,32(11):878-884.
[133]LU Y,HU Y,LIU R,et al.The design of simulation vehicle system controlled by multichannel EEG based on imaginary movements.Proceedings of the 35th Chinese Control Conference.Chengdu:IEEE,2016:4976-4981.
[134]KARRAY F,ALEMZADEH M,SALEH J A,et al.Humancomputer interaction:overview on state of the art.International Journal on Smart Sensing and Intelligent Systems,2008,1(1):137-159.
[135]AL-KAFF A,MARTIN D,GARCIA F,et al.Survey of computer vision algorithms and applications for unmanned aerial vehicles.Expert Systems with Applications,2018,92(2):447-463.
[136]CARRIO A,SAMPERDRO C,RODRIGUEZ R A,et al.A review of deep learning methods and applications for unmanned aerial vehicles.Journal of Sensors,2017,DOI:10.1155/2017/3296874.
[137]KIM I,MORRISON J R.Learning based framework for joint task allocation and system design in stochastic multi-UAV systems.2018International Conference on Unmanned Aircraft Systems.Texas:IEEE,2018:324-334.
[138]JIANG Y.A survey of task allocation and load balancing in distributed systems.IEEE Transactions on Parallel and Distributed Systems,2016,27(2):585-599.
[139]LOWE R,WU Y,TAMAR A,et al.Multi-agent actor-critic for mixed cooperative-competitive environments.Advances in Neural Information Processing Systems 30.Long Beach:Curran Associates,2017:6382-6393.
[140]HONORABLE K M F,MARY J M.Unmanned systems integrated roadmap FY 2011-2036.US:Office of the Secretary of Defense,2011,
[141]HADAEGH F Y,CHUNG S J,MANOHARA H M.On development of 100-gram-class spacecraft for swarm applications.IEEESystems Journal,2016,10(2):673-684.
[142]CHUNG S J,PARANJAPE A A,DAMES P,et al.A survey on aerial swarm robotics.IEEE Transactions on Robotics,2018,34(4):837-855.
[143]EVERETT M,CHEN Y F,HOW J P.Motion planning among dynamic,decision-making agents with deep reinforcement learning.ArXiv Preprint.2018,arXiv:1805.01956.
[144]WANG J X,KURTH N Z,TIRUMALA D,et al.Learning to reinforcement learn.ArXiv Preprint.2016,arXiv:1611.05763.
[145]DUAN Y,SCHULMAN J,CHEN X,et al.Rl2:Fast reinforcement learning via slow reinforcement learning.ArXiv Preprint.2016,arXiv:1611.02779.
[146]FINN C,ABBEEL P,LEVIN S.Model-agnostic meta-learning for fast adaptation of deep networks.ArXiv Preprint.2017,arXiv:1703.03400.
[147]MIOTTO R,WANG F,WANG S,et al.Deep learning for healthcare:review,opportunities and challenges.Briefings in Bioinformatics,2017,18(6):1236-1246.
[148]ZHAO G,ZHAGN G,GE Q,et al.Research advances in fault diagnosis and prognostic based on deep learning.Prognostics and System Health Management Conference.Chengdu:IEEE,2016:1-6.
[149]LEI Y,JIA F,LIN J,et al.An intelligent fault diagnosis method using unsupervised feature learning towards mechanical big data.IEEE Transactions on Industrial Electronics,2016,63(5):3137-3147.
[150]LIU R,YANG B,ZIO E,et al.Artificial intelligence for fault diagnosis of rotating machinery:A review.Mechanical Systems and Signal Processing,2018,108(8):33-47.
[151]NIKFARJAM A,SARKER A,O’CONNOR K,et al.Pharmacovigilance from social media:mining adverse drug reaction mentions using sequence labeling with word embedding cluster features.Journal of the American Medical Informatics Association,2015,22(3):671-681.
[152]CROWLEY J.Put that there:20 years of research on multimodal interaction.Proceedings of the 2018 on International Conference on Multimodal Interaction.Colorado:ACM,2018:4-4.
[153]WANG Dangxiao,ZHENG Yilei,LI Teng,et al.Multi-modal human-machine interaction for human intelligence augmentation.Scientia Sinica Informationis,2018,48(4):449-465.(王党校,郑一磊,李腾,等.面向人类智能增强的多模态人机交互.中国科学:信息科学,2018,48(4):449-465.)
© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号 地址：北京市海淀区学院路29号 邮编：100083 电话：办公室：(+86 10)66554848；文献借阅、咨询服务、科技查新：66554700 |