基于神经能量场梯度的智力探索
|
摘要
啮齿类动物可以在海马中形成代表环境的认知地图来解决空间问题。在经典的认知地图模型中,系统需要大量物理探索来学习空间环境,从而解决寻路问题,这个过程会耗费大量时间和能量。虽然Hopfield的智力探索模型弥补了这个缺陷,但是该模型并没有关注路径的高效性。并且这个模型主要来自于人工神经网络,缺乏明确的生理学意义。该计算模型在智力探索概念的基础上,运用神经能量编码的理论来解决路径搜索问题:该模型通过位置细胞集群的发放功率构建一种能量场,并计算能量场的梯度,进而用梯度向量来研究智力探索问题。研究结果表明提出的这种新的智力探索模型不仅可以更高效地找到优化路径,而且呈现了具有生物物理学意义的学习过程。这种新思路验证了位置细胞和突触对空间记忆的重要性以及能量编码的有效性,为了解空间记忆的神经动力学机制提供了理论基础。
Rodent animals can solve the space problem by means of forming a cognitive map in the hippocampus representing the environment. In the classic model of cognitive map,the system needs large amount of physical exploration to study the spatial environment so as to solve path-finding problems,which costs a lot of time and energy. Although the Hopfield's mental exploration model makes up the deficiency mentioned above,the efficiency of the path has not been focused in the model. Moreover,this model mainly comes from the artificial neural network,lacking of clear physiological significance. In the paper,based on the concept of mental exploration,the neural energy coding theory was applied to the calculation model so as to solve the path search problem: an energy field was constructed in the model on the basis of the firing power of position cell clusters,and the energy field gradient was calculated which can be used to study the mental exploration problem. The study shows that the new mental exploration model proposed can efficiently find the optimal path,and present the learning process with biophysical meaning as well. The new idea verifies the importance of position cell and synapse on the spatial memory and the efficiency of energy coding,which provides the theoretical basis for the neural dynamics mechanism of spatial memory.
Rodent animals can solve the space problem by means of forming a cognitive map in the hippocampus representing the environment. In the classic model of cognitive map,the system needs large amount of physical exploration to study the spatial environment so as to solve path-finding problems,which costs a lot of time and energy. Although the Hopfield's mental exploration model makes up the deficiency mentioned above,the efficiency of the path has not been focused in the model. Moreover,this model mainly comes from the artificial neural network,lacking of clear physiological significance. In the paper,based on the concept of mental exploration,the neural energy coding theory was applied to the calculation model so as to solve the path search problem: an energy field was constructed in the model on the basis of the firing power of position cell clusters,and the energy field gradient was calculated which can be used to study the mental exploration problem. The study shows that the new mental exploration model proposed can efficiently find the optimal path,and present the learning process with biophysical meaning as well. The new idea verifies the importance of position cell and synapse on the spatial memory and the efficiency of energy coding,which provides the theoretical basis for the neural dynamics mechanism of spatial memory.
引文
[1]TOLMAN E C.Cognitive maps in rats and men[J].Psychological Review,1948,55:189-208.
[2]O'KEEFE J,NADEL L.The hippocampus as a cognitive map[M].Oxford:Oxford University Press,1978.
[3]REDISH A D,TOURETZKY D S.Beyond the cognitive map[D].Pittsburg,PA:Carnegie Mellon University,1997.
[4]朱青,王如彬.基于智力探索的认知神经动力学[J].振动与冲击,2013,32(2):189-200.ZHU Qing,WANG Rubin.The cognitive neurodynamics based on mental exploration[J].Journal of Vibration and Shock,2013,32(2):189-200.
[5]WILSON M A,MCNAUGHTON B L.Dynamics of the hippocampal ensemble code for space[J].Science,1993,261:1055-1058.
[6]REDISH A D.Beyond the cognitive map[M].Cambridge:The MIT Press,1999.
[7]MULLER R U,KUBIE J L.The effects of changes in the environment on the spatial firing of hippocampal complexspike cells[J].J Neurosci,1987,7(7):1951-1968.
[8]BOSTOCK E,MULLER R U,KUBIE J L.Experiencedependent modifications of hippocampal place cell firing[J].Hippocampus,1991,1(2):193-205.
[9]GOTHARD K M,SKAGGS W E,MOORE K M,et al.Binding of hippocampal CA1 neural activity to multiple reference frames in a landmark-based navigation task[J].J Neurosci,1996,16(2):823-835.
[10]MULLER R U,KUBIE J L,SAYPOFF R.The hippocampus as a cognitive graph(abridged version)[J].Hippocampus,1991,1(3):243-246.
[11]MULLER R U,STEAD M,PACH J.The hippocampus as a cognitive graph[J].J Gen Physiol,1996,107(6):663-694.
[12]BURGESS N,RECCE M,O’KEEFE J.A model of hippocampal function[J].Neural Networks,1994,7(6/7):1065-1081.
[13]BLUM K I,ABBOTT L F.A model of spatial map formation in the hippocampus of the rat[J].Neural Comput,1996,8(1):85-93.
[14]GERSTNER W,ABBOTT L F.Learning navigational maps through potentiation and modulation of hippocampal place cells[J].J Comput Neurosci,1997,4(1):79-94.
[15]REDISH A D,TOURETZKY D S.The role of the hippocampus in solving the Morris water maze[J].Neural Comput,1998,10(1):73-111.
[16]TRULLIER O,MEYER J A.Animat navigation using a cognitive graph[J].Biol Cybernet,2000,83(3):271-285.
[17]HOPFIELD J J.Neurodynamics of mental exploration[J].PNAS,2010,107(4):1648-1653.
[18]WANG R B,ZHANG Z K.Mechanism on brain information processing:energy coding[J].Applied Physical Letters(APL),2006,89:123903.
[19]WANG R B,ZHANG Z K.Energy coding in biological neural network[J].Cognitive Neurodynamics,2007,1(3):203-212.
[20]WANG R B,ZHANG Z K,CHEN G R.Energy function and energy evolution on neural population[J].IEEE Transactions on Neural Networks,2008,19(3):535-538.
[21]WANG R B,ZHANG Z K,CHEN G R.Energy coding and energy functions for local activities of brain[J].Neurocomputing,2009,73(1/2/3):139-150.
[22]WANG R B,ZHANG Z K.Computation of neuronal energy based on information coding[J].Chinese Journal of Theoretical and Applied Mechanics,2012,44(4):779-786.
[23]WANG R B,WANG Z Y,TSUDA I.Can neural information be represented as neural energy?[J].Front Comput Neurosci,2015,9:7.
[24]WANG R B,WANG Z Y.Energy distribution property and energy coding of a structural neural network[J].Front Comput Neurosci,2014,8:14.
[25]WANG R B,TSUDA I,ZHANG Z K.A new work mechanism on neuronal activity[J].International Journal of Neural Systems,2015,25(1):1450037.
[26]王如彬,张志康.基于信息编码的神经能量计算[J].力学学报,2012,44(4):779-786.WANG Rubin,ZHANG Zhikang.Computation of neural energy based on information coding[J].Chinese Journal of Theoretical and Applied Mechanics,2012,44(4):779-786.
[27]郑锦超,王如彬,张志康,等.神经能量与神经信息之间内在动力学关系初探[J].力学学报,2012,44(5):919-927.ZHENG Jinchao,WANG Rubin,ZHANG Zhikang,et al.The first exploration of the dynamic relation between nervous energy and neural information[J].Chinese Journal of Theoretical and Applied Mechanics,2012,44(5):919-927.
[28]王如彬,张志康.耦合条件下大脑皮层神经振子群的能量函数[J].力学学报,2008,40(2):238-249.WANG Rubin,ZHANG Zhikang.Energy function of population of neural oscillators in cerebral cortex under coupling condition[J].Chinese Journal of Theoretical and Applied Mechanics,2008,40(2):238-249.
[2]O'KEEFE J,NADEL L.The hippocampus as a cognitive map[M].Oxford:Oxford University Press,1978.
[3]REDISH A D,TOURETZKY D S.Beyond the cognitive map[D].Pittsburg,PA:Carnegie Mellon University,1997.
[4]朱青,王如彬.基于智力探索的认知神经动力学[J].振动与冲击,2013,32(2):189-200.ZHU Qing,WANG Rubin.The cognitive neurodynamics based on mental exploration[J].Journal of Vibration and Shock,2013,32(2):189-200.
[5]WILSON M A,MCNAUGHTON B L.Dynamics of the hippocampal ensemble code for space[J].Science,1993,261:1055-1058.
[6]REDISH A D.Beyond the cognitive map[M].Cambridge:The MIT Press,1999.
[7]MULLER R U,KUBIE J L.The effects of changes in the environment on the spatial firing of hippocampal complexspike cells[J].J Neurosci,1987,7(7):1951-1968.
[8]BOSTOCK E,MULLER R U,KUBIE J L.Experiencedependent modifications of hippocampal place cell firing[J].Hippocampus,1991,1(2):193-205.
[9]GOTHARD K M,SKAGGS W E,MOORE K M,et al.Binding of hippocampal CA1 neural activity to multiple reference frames in a landmark-based navigation task[J].J Neurosci,1996,16(2):823-835.
[10]MULLER R U,KUBIE J L,SAYPOFF R.The hippocampus as a cognitive graph(abridged version)[J].Hippocampus,1991,1(3):243-246.
[11]MULLER R U,STEAD M,PACH J.The hippocampus as a cognitive graph[J].J Gen Physiol,1996,107(6):663-694.
[12]BURGESS N,RECCE M,O’KEEFE J.A model of hippocampal function[J].Neural Networks,1994,7(6/7):1065-1081.
[13]BLUM K I,ABBOTT L F.A model of spatial map formation in the hippocampus of the rat[J].Neural Comput,1996,8(1):85-93.
[14]GERSTNER W,ABBOTT L F.Learning navigational maps through potentiation and modulation of hippocampal place cells[J].J Comput Neurosci,1997,4(1):79-94.
[15]REDISH A D,TOURETZKY D S.The role of the hippocampus in solving the Morris water maze[J].Neural Comput,1998,10(1):73-111.
[16]TRULLIER O,MEYER J A.Animat navigation using a cognitive graph[J].Biol Cybernet,2000,83(3):271-285.
[17]HOPFIELD J J.Neurodynamics of mental exploration[J].PNAS,2010,107(4):1648-1653.
[18]WANG R B,ZHANG Z K.Mechanism on brain information processing:energy coding[J].Applied Physical Letters(APL),2006,89:123903.
[19]WANG R B,ZHANG Z K.Energy coding in biological neural network[J].Cognitive Neurodynamics,2007,1(3):203-212.
[20]WANG R B,ZHANG Z K,CHEN G R.Energy function and energy evolution on neural population[J].IEEE Transactions on Neural Networks,2008,19(3):535-538.
[21]WANG R B,ZHANG Z K,CHEN G R.Energy coding and energy functions for local activities of brain[J].Neurocomputing,2009,73(1/2/3):139-150.
[22]WANG R B,ZHANG Z K.Computation of neuronal energy based on information coding[J].Chinese Journal of Theoretical and Applied Mechanics,2012,44(4):779-786.
[23]WANG R B,WANG Z Y,TSUDA I.Can neural information be represented as neural energy?[J].Front Comput Neurosci,2015,9:7.
[24]WANG R B,WANG Z Y.Energy distribution property and energy coding of a structural neural network[J].Front Comput Neurosci,2014,8:14.
[25]WANG R B,TSUDA I,ZHANG Z K.A new work mechanism on neuronal activity[J].International Journal of Neural Systems,2015,25(1):1450037.
[26]王如彬,张志康.基于信息编码的神经能量计算[J].力学学报,2012,44(4):779-786.WANG Rubin,ZHANG Zhikang.Computation of neural energy based on information coding[J].Chinese Journal of Theoretical and Applied Mechanics,2012,44(4):779-786.
[27]郑锦超,王如彬,张志康,等.神经能量与神经信息之间内在动力学关系初探[J].力学学报,2012,44(5):919-927.ZHENG Jinchao,WANG Rubin,ZHANG Zhikang,et al.The first exploration of the dynamic relation between nervous energy and neural information[J].Chinese Journal of Theoretical and Applied Mechanics,2012,44(5):919-927.
[28]王如彬,张志康.耦合条件下大脑皮层神经振子群的能量函数[J].力学学报,2008,40(2):238-249.WANG Rubin,ZHANG Zhikang.Energy function of population of neural oscillators in cerebral cortex under coupling condition[J].Chinese Journal of Theoretical and Applied Mechanics,2008,40(2):238-249.