Compact yet efficient hardware implementation of artificial neural networks with customized topology
- 作者：Nadia Nedjaha ; 1 ; nadia@eng.uerj.br ; Rodrigo Martins da Silvaa ; 1 ; martins@uerj.br ; Luiza de Macedo Mourelleb ; 1 ; ldmm@eng.uerj.br
- 关键词：Artificial neural networks ; Hardware for neural networks ; Topology ; Sigmoid activation function ; Parallelism ; FPGA
- 刊名：Expert Systems with Applications
- 出版年：2012
- 期刊代码：62_09574174
- 类别：et
- 出版时间：August, 2012
- 卷：39
- 期：10
- 页码：9191-9206
- 文件大小：1082 K
摘要
There are several neural network implementations using either software, hardware-based or a hardware/software co-design. This work proposes a hardware architecture to implement an artificial neural network (ANN), whose topology is the multilayer perceptron (MLP). In this paper, we explore the parallelism of neural networks and allow on-the-fly changes of the number of inputs, number of layers and number of neurons per layer of the net. This reconfigurability characteristic permits that any application of ANNs may be implemented using the proposed hardware. In order to reduce the processing time that is spent in arithmetic computation, a real number is represented using a fraction of integers. In this way, the arithmetic is limited to integer operations, performed by fast combinational circuits. A simple state machine is required to control sums and products of fractions. Sigmoid is used as the activation function in the proposed implementation. It is approximated by polynomials, whose underlying computation requires only sums and products. A theorem is introduced and proven so as to cover the arithmetic strategy of the computation of the activation function. Thus, the arithmetic circuitry used to implement the neuron weighted sum is reused for computing the sigmoid. This resource sharing decreased drastically the total area of the system. After modeling and simulation for functionality validation, the proposed architecture synthesized using reconfigurable hardware. The results are promising.