An Improved Supervised Learning Algorithm Using Triplet-Based Spike-Timing-Dependent Plasticity
详细信息 查看全文
- 关键词：Spiking neural networks ; Supervised learning ; Triplet ; based spike ; timing ; dependent plasticity ; Remote supervised method
- 刊名：Lecture Notes in Computer Science
- 出版年：2016
- 出版时间：2016
- 年：2016
- 卷：9773
- 期：1
- 页码：44-53
- 全文大小：272 KB
- 参考文献：1.Rosenblatt, F.: The Perceptron: A Perceiving and Recognizing Automaton Project Para. Cornell Aeronautical Laboratory (1957)
2.Rumelhart, D.E., Hinton, G.E., Williams, R.J.: Learning representations by back-propagating errors. Nature 323(6088), 533–536 (1986)CrossRef
3.Bohte, S.M.: The evidence for neural information processing with precise spike-times: a survey. Nat. Comput. 3(2), 195–206 (2004)MathSciNet CrossRef MATH
4.Ghosh-Dastidar, S., Adeli, H.: Spiking neural networks. Int. J. Neural Syst. 19, 295–308 (2009)CrossRef
5.Kerr, D., McGinnity, T.M., Coleman, S., et al.: A biologically inspired spiking model of visual processing for image feature detection. Neurocomputing 158, 268–280 (2015)CrossRef
6.Cao, Z., Cheng, L., Zhou, C., et al.: Spiking neural network-based target tracking control for autonomous mobile robots. Neural Comput. Appl. 26(8), 1839–1847 (2015)CrossRef
7.Dennis, J., Tran, H.D., Li, H.: Spiking neural networks and the generalised hough transform for speech pattern detection. In: The 16th Annual Conference of the International Speech Communication Association (2015)
8.Lin, X., Wang, X., Zhang, N., et al.: Supervised learning algorithms for spiking neural networks: a review. Acta Electronica Sinica 43(3), 577–586 (2015)
9.Hebb, D.O.: The Organization of Behavior: A Neuropsychological Theory. Wiley, New York (1949)
10.Abbott, L.F., Nelson, S.B.: Synaptic plasticity - taming the beast. Nat. Neurosci. 3, 1178–1183 (2000)CrossRef
11.Wang, H., Gerkin, R., Nauen, D., et al.: Coactivation and timing dependent integration of synaptic potentiation and depression. Nat. Neurosci. 8(2), 187–193 (2005)CrossRef
12.Markram, H., Gerstner, W., Sjöström, P.J.: Spike-timing-dependent plasticity: a comprehensive overview. Front. Synaptic Neurosci. 4, 8 (2012)CrossRef
13.Daniel, E.F.: The spike-timing dependence of plasticity. Neuron 75(8), 558–571 (2012)
14.Serrano-Gotarredona, T., Masquelier, T., Prodromakis, T., et al.: STDP and STDP variations with memristors for spiking neuromorphic learning systems. Front Neurosci 7(2), 1–15 (2013)
15.Pfister, J.P., Gerstner, W.: Triplets of spikes in a model of spike timing dependent plasticity. J. Neurosci. 26(38), 9673–9682 (2006)CrossRef
16.Shahim-Aeen, A., Karimi, G.: Triplet-based spike timing dependent plasticity (TSTDP) modeling using VHDL-AMS. Neurocomput. 149, 1440–1444 (2015)CrossRef
17.Ruf, B., Schmitt, M.: Learning temporally encoded patterns in networks of spiking neurons. Neural Process. Lett. 5(1), 9–18 (1997)CrossRef
18.Legenstein, R., Naeger, C., Maass, W.: What can a neuron learn with spike-timing-dependent plasticity? Neural Comput. 17(11), 2337–2382 (2005)MathSciNet CrossRef MATH
19.Franosch, J.M.P., Urban, S., van Hemmen, J.L.: Supervised spike-timing-dependent plasticity: a spatiotemporal neuronal learning rule for function approximation and decisions. Neural Comput. 25(12), 3113–3130 (2013)MathSciNet CrossRef
20.Ponulak, F., Kasinski, A.: Supervised learning in spiking neural networks with ReSuMe: sequence learning, classification and spike shifting. Neural Comput. 22(10), 467–510 (2010)MathSciNet CrossRef MATH
21.Hu, J., Tang, H., Tan, K.C., et al.: A spike-timing-based integrated model for pattern recognition. Neural Comput. 25(2), 450–472 (2013)MathSciNet CrossRef MATH
22.Bi, G., Poo, M.: Synaptic modifications in cultured hippocampal neurons: dependence on spike timing, synaptic strength and postsynaptic cell type. J. Neurosci. 18(24), 10464–10472 (1998)
23.Pfister, J.P., Gerstner,W.: Beyond pair-based STDP: a phenomenological rule for spike triplet and frequency effects. In: Advance Neural Information Process System, vol. 18, pp. 1083–1090 (2006)
24.Gjorgjieva, J., Clopath, C., Audet, J., et al.: A triplet spike-timing-dependent plasticity model generalizes the bienenstock-cooper-munro rule to higher-order spatiotemporal correlations. Proc. Natl. Acad. Sci. 108(48), 19383–19388 (2011)CrossRef
25.Gerstner, W., Kistler, W.M.: Spiking Neuron Models: Single Neurons, Populations, Plasticity. Cambridge University Press, Cambridge (2002)CrossRef MATH - 作者单位：Xianghong Lin (16)
Guojun Chen (16)
Xiangwen Wang (16)
Huifang Ma (16)
16. School of Computer Science and Engineering, Northwest Normal University, Lanzhou, 730070, China - 丛书名：Intelligent Computing Methodologies
- ISBN：978-3-319-42297-8
- 刊物类别：Computer Science
- 刊物主题：Artificial Intelligence and Robotics
Computer Communication Networks
Software Engineering
Data Encryption
Database Management
Computation by Abstract Devices
Algorithm Analysis and Problem Complexity - 出版者：Springer Berlin / Heidelberg
- ISSN：1611-3349
- 卷排序：9773
文摘
The purpose of supervised learning with temporal encoding for spiking neurons is to make the neurons emit arbitrary spike trains in response to given synaptic inputs. Recent years, the supervised learning algorithms based on synaptic plasticity have developed rapidly. As one of the most efficient supervised learning algorithms, the remote supervised method (ReSuMe) uses the conventional pair-based spike-timing-dependent plasticity rule, which depends on the precise timing of presynaptic and postsynaptic spikes. In this paper, using the triplet-based spike-timing-dependent plasticity, which is a powerful synaptic plasticity rule and acts beyond the classical rule, a novel supervised learning algorithm, dubbed T-ReSuMe, is presented to improve ReSuMe’s performance. The proposed algorithm is successfully applied to various spike trains learning tasks, in which the desired spike trains are encoded by Poisson process. The experimental results show that T-ReSuMe has higher learning accuracy and fewer iteration epoches than the traditional ReSuMe, so it is effective for solving complex spatio-temporal pattern learning problems.