Evolving efficient learning algorithms for binary mappings

详细信息    查看全文

• 作者：Bullinaria ; John A.
• 关键词：Neural network ; Learning algorithms ; Evolution ; Binary mappings
• 刊名：Neural Networks
• 出版年：2003
• 出版时间：June - July, 2003
• 年：2003
• 卷：16
• 期：5-6
• 页码：793-800
• 全文大小：360 K

文摘

Gradient descent training of sigmoidal feed-forward neural networks on binary mappings often gets stuck with someout puts totally wrong. This is because a sum-squared-error cost function leads to weight updates that depend on the derivative of the output sigmoid which goes to zero as the output approaches maximal error. Although it is easy to understand the cause, the best remedy is not so obvious. Common solutions involve modifying the training data, deviating from true gradient descent, or changing the cost function. In general, finding the best learning procedures for particular classes of problem is difficult because each usually depends on a number of interacting parameters that need to be set to optimal values for a fair comparison. In this paper I shall use simulated evolution to optimise all the relevant parameters, and come to a clear conclusion concerning the most efficient approach for learning binary mappings.