A fast and memory saved GPU acceleration algorithm of convolutional neural networks for target detection

详细信息    查看全文

• 作者：Shijie Li^a ; ^b ; ^{lishijienudt@163.com}Author Vitae ; Yong Dou^a ; ^bAuthor Vitae ; Xin Niu^a ; ^bAuthor Vitae ; Qi Lv^a ; ^bAuthor Vitae ; Qiang Wang^a ; ^bAuthor Vitae
• 关键词：Convolutional neural networks ; GPU ; Target detection
• 刊名：Neurocomputing
• 出版年：2017
• 出版时间：22 March 2017
• 年：2017
• 卷：230
• 期：Complete
• 页码：48-59
• 全文大小：2026 K
• 卷排序：230

文摘

Target detection is a hard real-time task for video and image processing. This task has recently been accomplished through the feedforward process of convolutional neural networks (CNN), which is usually accelerated by general-purpose graphic units (GPUs). However, there are two challenges for this task. One is that the running speed remains to be improved. The other is that we probably use a deeper and larger CNN model, but a more sophisticated model may not be trained well due to the shortage of GPU memory. In this paper, we present two scheduling algorithms to solve the aforementioned challenges for improving the system performance holistically. The first one is an efficient image combination algorithm used to accelerate the feedforward process of CNN. The other is a light-memory-cost algorithm used to train an arbitrarily large CNN model for a GPU device with a limited memory. We run our experiments on a GTX980 card and use a CNN model with 8 GB of model parameters, which is larger than the size of the global memory of a GPU. Compared with that of cuDNNv3, a high speedup of 6.97x is obtained in the detection task.