级联优化CNN的手指静脉图像质量评估
详细信息    查看全文 | 推荐本文 |
  • 英文篇名:Finger vein image quality assessment based on cascaded fine-tuning convolutional neural network
  • 作者:曾军英 ; 谌瑶 ; 秦传波 ; 甘俊英 ; 翟懿奎 ; 冯武林
  • 英文作者:Zeng Junying;Chen Yao;Qin Chuanbo;Gan Junying;Zhai Yikui;Feng Wulin;Department of Information Engineering,Wuyi University;
  • 关键词:手指静脉质量评估 ; 卷积神经网络 ; 特征融合 ; 多通道CNN ; 级联优化CNN
  • 英文关键词:finger vein quality assessment;;CNN(convolutional neural network);;feature fusion;;MC-CNN(multi-column CNN);;CF-CNN(cascaded fine-tuning CNN)
  • 中文刊名:ZGTB
  • 英文刊名:Journal of Image and Graphics
  • 机构:五邑大学信息工程学院;
  • 出版日期:2019-06-16
  • 出版单位:中国图象图形学报
  • 年:2019
  • 期:v.24;No.278
  • 基金:国家自然科学基金项目(61771347,61372193);; 广东高等学校优秀青年培养计划项目(SYQ2014001);; 广东省特色创新类项目(2017KTSCX181);; 广东省青年创新人才类项目(2017KQNCX206,2015KQNCX172);; 五邑大学青年科研基金(2015zk11);; 江门市科技计划项目(江科[2017]268)~~
  • 语种:中文;
  • 页:ZGTB201906006
  • 页数:12
  • CN:06
  • ISSN:11-3758/TB
  • 分类号:60-71
摘要
目的针对手动设计的手指静脉质量特征计算过程复杂、鲁棒性差、表达效果不理想等问题,提出了基于级联优化CNN(卷积神经网络)进行多特征融合的手指静脉质量评估方法。方法以半自动化方式对手指静脉公开数据库MMCBNU_6000进行质量标注并用R-SMOTE(radom-synthetic minority over-sampling technique)算法平衡类别;将深度学习中的CNN结构应用到手指静脉质量评估并研究了不同的网络深度对表征手指静脉质量的影响;受到传统方法中将二值图像和灰度图像结合进行质量评估的启发,设计了两种融合灰度图像和二值图像的质量特征的模型:多通道CNN(MC-CNN)和级联优化CNN(CF-CNN),MC-CNN在训练和测试时均需要同时输入二值图像和灰度图像,CF-CNN在训练时分阶段输入二值图像和灰度图像,测试时只需输入灰度图像。结果本文设计的3种简单CNN结构(CNN-K,K=3,4,5)在MMCBNU_6000数据库上对测试集图像的分类正确率分别为93. 31%、93. 94%、85. 63%,以灰度图像和二值图像分别作为CNN-4的输入在MMCBNU_6000数据库上对测试集图像的分类正确率对应为93. 94%、91. 92%,MC-CNN和CF-CNN在MMCBNU_6000数据库上对测试集图像的分类正确率分别为91. 44%、94. 62%,此外,与现有的其他算法相比,CF-CNN在MMCBNU_6000数据库上对高质量测试图像、低质量测试图像、整体测试集图像的分类正确率均最高。结论实验结果表明,基于CF-CNN学习到的融合质量特征比现有的手工特征和基于单一静脉形式学习到的特征表达效果更好,可以有效地对手指静脉图像进行高、低质量的区分。
        Objective Finger vein recognition,an emerging biometric identification technology,has attracted the attention of numerous researchers. However,the quality of several collected finger vein images is not ideal due to individual differences,changes in the collection environment,and differences in the performance of acquisition equipment. In a finger vein recognition system,low-quality images seriously affect feature extraction and matching,resulting in poor identification performance of the system. In an application scene that requires the establishment of a standard template library of personal finger vein information in real life,registered low-quality images seriously influence the use of the finger vein standard template library. Therefore,correct quality assessment after collecting finger vein images is necessary to filter low-quality images and select high-quality ones to be inputted to a finger vein recognition system or to register a finger vein standard template library. To address the problems of considerable computation complexity,weak robustness,and unsatisfactory expression and the issue that the hand-crafted finger vein quality characteristic is sensitive to various factors,we develop a finger vein quality assessment method. These problems are addressed via multi-feature fusion,which is primarily based on the cascaded fine-tuning convolutional neural network( CNN). Method Finger vein image quality assessment methods based on deep learning require many labeled finger vein images. However,existing finger vein image public databases only provide finger vein images and do not mark them for quality. Thus,the first step should be labeling. In this study,the public finger vein database MMCBNU _ 6000 is labeled for quality representation in a semi-automated manner. This manner is based on the calculation of the number of veins in a finger vein image,followed by manual correction. Such an annotation method is more accurate,time saving,and cost effective than a pure manual annotation method. However,the collected low-quality finger vein images are fewer than the high-quality finger vein images in the actual scene; hence,the R-SMOTE algorithm is employed to balance all categories. The excellent capabilities of deep neural networks have been proven in the fields of image and speech. However,with regard to finger vein quality assessment,most existing methods are based on hand-crafted features,and only a few methods gain quality features via self-learning. In this study,the CNN structure in deep learning is applied to finger vein quality assessment,and the depth of the CNN framework is investigated for its contribution to quality representation. Deeper networks may not be good at representing the quality characteristics of finger vein images. The best network depth is confirmed after an experiment and used as the basis for subsequent research. Meanwhile,inspired by the combination of binary and grayscale images in traditional quality evaluation,two models,namely,multi-column CNN( MC-CNN) and cascaded fine-tuning CNN( CF-CNN),are designed to merge the quality features of grayscale and binary images. When MC-CNN is trained and tested,binary and grayscale images must be inputted together to the model. As for CF-CNN,binary and grayscale images are inputted to the model in stages during training,and only the grayscale image is inputted during testing. Notably,we input the binary finger vein image to the network and verify that the quality characteristics of the binary finger vein help distinguish high-and low-quality finger vein images. After verification,we obtain a basis to believe that the combination of binary and grayscale images through CNN produces remarkable results.Result Several experimental results for testing are set on the MMCBNU_ 6000 database. The classification accuracy rates of the CNN-K( K = 3,4,5) designed in this study are 93. 31%,93. 94%,and 85. 63%,respectively; the classification accuracy rates of CNN-4 with grayscale and binary images as the input are 93. 94% and 91. 92%,and the classification accuracy rates of MC-CNN and CF-CNN are 91. 44% and 94. 62%,respectively. The experimental results of the simple CNN structure show that CNN-3 has the highest classification accuracy rate for high-quality images,CNN-5 has the highest classification accuracy rate for low-quality images,and CNN-4 has the highest classification accuracy rate for the entire test set. The experimental results of CNN-4 show that the grayscale vein form performs better than the binary vein form. Meanwhile,the experimental results of the complex CNN structure show that CF-CNN performs better than MC-CNN. Compared with other existing algorithms,CF-CNN has the highest classification accuracy rate for high-quality,low-quality,and overall test images on the MMCBNU_ 6000 database. Conclusion First,three simple CNN structures are designed and used for finger vein quality assessment. The comprehensive performance of CNN-4 is found to be better than that of CNN-3 and CNN-5,indicating that the network is not as deep as possible,and the structure of the network should be adjusted to suit the research questions. Second,the performance difference when gray and binary images are used for the same network is compared. Results show that both images characterize the vein quality to varying degrees. Finally,to fuse the quality features of grayscale and binary images,two fusion models( MC-CNN and CF-CNN) are proposed. CF-CNN,an end-to-end quality evaluation model of finger veins,is better than MC-CNN and has a simpler structure. In summary,our method demonstrates state-of-the-art performance and obtains better features than those from existing manual and single vein forms.
引文
[1]Wang K J,Liu J Y,Ma H,et al.A finger vein image quality assessment method[J].CAAI Transactions on Intelligent Systems,2011,6(4):324-327.[王科俊,刘靖宇,马慧,等.手指静脉图像质量评价[J].智能系统学报,2011,6(4):324-327.][DOI:10.3969/j.issn.1673-4785.2011.04.007]
    [2]Ma H,Wang K J,Fan L L,et al.A finger vein image quality assessment method using object and human visual system index[M]//Yang J,Fang F,Sun C Y.Intelligent Science and Intelligent Data Engineering.Berlin,Heidelberg:Springer,2012:498-506.[DOI:10.1007/978-3-642-36669-7_61]
    [3]Xie S J,Zhou B,Yang J C,et al.Novel hierarchical structure based finger vein image quality assessment[M]//Sun Z A,Shan S G,Yang G P,et al.Biometric Recognition.Cham:Springer,2013:266-273.[DOI:10.1007/978-3-319-02961-0_33]
    [4]Huang Z Z,Mu C D,Xie J B,et al.Vein image quality assessment method for feature extraction[J].Computer Engineering and Science,2013,35(10):186-190.[黄忠主,穆春迪,谢剑斌,等.用于特征提取的静脉图像质量评价方法[J].计算机工程与科学,2013,35(10):186-190.][DOI:10.3969/j.issn.1007-130X.2013.10.026]
    [5]Yang L,Yang G P,Yin Y L,et al.Finger vein image quality evaluation using support vector machines[J].Optical Engineering,2013,52(2):027003.[DOI:10.1117/1.OE.52.2.027003]
    [6]Zhou L Z,Yang G P,Yang L,et al.Finger vein image quality evaluation based on support vector regression[J].International Journal of Signal Processing,Image Processing and Pattern Recognition,2015,8(8):211-222.[DOI:10.14257/ijsip.2015.8.8.23]
    [7]Qin H F.Study on quality assessment and feature recognition approach of finger-vein image[D].Chongqing:Chongqing University,2012.[秦华锋.手指静脉图像质量评估与特征识别算法研究[D].重庆:重庆大学,2012.]
    [8]Yang L.Study of finger vein recognition methods[D].Ji’nan:Shandong University,2016.[杨璐.手指静脉识别方法研究[D].济南:山东大学,2016.]
    [9]Hu J J.Study on quality assessment algorithm of finger vein image[D].Chongqing:Chongqing University of Technology,2016.[胡晶晶.手指静脉图像质量评估算法研究[D].重庆:重庆理工大学,2016.]
    [10]Nguyen D T,Park Y H,Shin K Y,et al.New finger-vein recognition method based on image quality assessment[J].KSIITransactions on Internet and Information Systems,2013,7(2):347-365.[DOI:10.3837/tiis.2013.02.010]
    [11]Huang Z X,Kang W X,Wu Q X,et al.A finger vein identification system based on image quality assessment[C]//Proceedings of the 11th Chinese Conference on Biometric Recognition.Chengdu,China:Springer,2016:244-254.[DOI:10.1007/978-3-319-46654-5_27]
    [12]Huang Z X.The embedded finger vein recognition system based on convolutional neural networks[D].Guangzhou:South China University of Technology,2017.[黄志星.基于卷积神经网络的嵌入式指静脉识别系统[D].广州:华南理工大学,2017.]
    [13]Qin H F,El-Yacoubi M A.Finger-vein quality assessment by representation learning from binary images[C]//Proceedings of the International Conference on Neural Information Processing.Istanbul,Turkey:Springer,2015:421-431.[DOI:10.1007/978-3-319-26532-2_46]
    [14]Qin H F,El-Yacoubi M A E.Deep representation for finger-vein image-quality assessment[J].IEEE Transactions on Circuits and Systems for Video Technology,2018,28(8):1677-1693.[DOI:10.1109/TCSVT.2017.2684826]
    [15]Lu Y,Xie S J,Yoon S,et al.An available database for the research of finger vein recognition[C]//Proceedings of the 6th International Congress on Image and Signal Processing.Hangzhou,China:IEEE,2014:410-415.[DOI:10.1109/CISP.2013.6744030]

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700