校园航拍图像超分辨率重建的粒计算方法
|
摘要
提出了校园航拍图像超分辨率重建的粒计算方法,包括:(1)提出了图像粒化方法,实现图像空间向粒度空间的转化;(2)设计粒之间合并运算和分解运算,构造粒之间的模糊包含关系μ和σ,实现不同粒度空间之间的转化,获取图像的先验知识,指导校园航拍图像超分辨率重建算法的设计;(3)根据自顶向下、自底向上两种模式和图像先验知识,设计校园航拍图像超分辨率重建粒计算算法,实现粒度空间向图像空间的转化.实验验证了提出方法的可行性.
Granular Computing( Gr C) is proposed for super-resolution reconstruction of aerial images in campus.( 1) The granulation method of image is proposed to transform the image space into granularity space.( 2) The join operation and the meet operation between two granules are designed for the fuzzy inclusion measure μ and σ between two granules,which are used to realize the transformation between two granularity spaces with different granularities,to obtain the prior knowledge to guide the design of super-resolution reconstruction algorithms.( 3) According to up-down and bottom-up computing models,the granular computing algorithms of image super-resolution reconstruction are designed to realize the transformation from granularity space to image space in terms of the prior knowledge. The proposed algorithms are verified by the experiments.
Granular Computing( Gr C) is proposed for super-resolution reconstruction of aerial images in campus.( 1) The granulation method of image is proposed to transform the image space into granularity space.( 2) The join operation and the meet operation between two granules are designed for the fuzzy inclusion measure μ and σ between two granules,which are used to realize the transformation between two granularity spaces with different granularities,to obtain the prior knowledge to guide the design of super-resolution reconstruction algorithms.( 3) According to up-down and bottom-up computing models,the granular computing algorithms of image super-resolution reconstruction are designed to realize the transformation from granularity space to image space in terms of the prior knowledge. The proposed algorithms are verified by the experiments.
引文
[1]陈玉臻.试论无人机航拍画面的形式美感:以《航拍中国》为例[D].杭州:浙江大学,2018.CHEN Yuzhen. On the aesthetic feeling of the aerial photograph of unmanned aerial vehicle:Taking“aerial Chian”as example[D]. Hangzhou:Zhejiang University,2018.
[2]张帆,付慧,杨刚.低空林地航拍图像拼接的改进缝合线算法[J].北京林业大学学报,2018,40(5):90-102.ZHANG Fan,FU Hui,YANG Gang. Improved optimal seamless-line algorithm of aerial image mosaic in low altitude woodland[J]. Journal of Beijing Forestry University,2018,40(5):90-102.
[3]陈苏婷,王卓,王奇.基于非线性尺度空间的航拍场景分类[J].上海交通大学学报,2017,51(10):1228-1234.CHEN Suting,WANG Zhuo,WANG Ji. Aerial scene classification based on nonlinear scale space[J]. Journal of Shanghai Jiaotong University,2017,51(10):1228-1234.
[4]孔颖,孙明轩,陆慧娟.多幅混合数字图像提取的迭代学习方法[J].小型微型计算机系统,2017,38(3):584-589.KONG Ying,SUN Mingxuan,LU Huijuan. Iterative learning method for extraction of digital images under multi-blending[J].Journal of Chinese Computer Systems,2017,38(3):584-589.
[5]田娟秀,刘国才,谷珊珊,等.医学图像分析深度学习方法研究与挑战[J].自动化学报,2018,44(3):401-424.TIAN Juanxiu,LIU Guocai,GU Shanshan,et al. Deep learning in medical image analysis and its challenges[J]. Acta Automatica Sinica,2018,44(3):401-424.
[6]尚存,李国梁,马文鹏,等.一种基于Arnold技术的彩色图像数字水印算法研究[J].信阳师范学院学报(自然科学版),2018,31(3):484-488.SHANG Cun,LI Guoliang,MA Wenpeng,et al. Research of digital watermarking algorithm of color image watermark embedded based on Arnold transformation[J]. Journal of Xinyang Normal University(Natural Science Edition),2018,31(3):484-488.
[7]BETZIG E,PATTERSON G H,SOUGRAT R,et al. Imaging intracellular fluorescent proteins at nanometer resolution[J].Science,2006,313(5793):1642-1645.
[8]ROWEIS S T,SAUL L K. Nonlinear dimensionality reduction by locally linear embedding[J]. Science(New York,N Y),2000,290(550):2323-2326.
[9]YANG Jianchao,WRIGHT J,HUANG T S,et al. Image super-resolution via sparse representation[J]. IEEE Transactions on Image Processing,2010,19(11):2861-2873.
[10]PELEG T,ELAD M. A statistical prediction model based on sparse representations for single image super-resolution[J].IEEE Transactions on Image Processing,2014,23(6):2569-2582.
[11]SHIN D K,MOON Y S. Super-resolution image reconstruction using wavelet based patch and discrete wavelet transform[J].Journal of Signal Processing Systems for Signal Image and Video Technology,2015,81(1):71-81.
[12]樊子德,龚健雅,刘博,等.顾及时空异质性的缺失数据时空插值方法[J].测绘学报,2016,45(4):458-465.FAN Zide,GONG Jianya,LIU Bo,et al. A space-time interpolation method of missing data based on spatio-temporal heterogeneity[J]. Acta Geodaetica et Cartographica Sinica,2016,45(4):458-465.
[13]肖进胜,饶天宇,贾茜,等.改进的自适应冲击滤波图像超分辨率插值算法[J].计算机学报,2015,38(6):1131-1139.XIAO Jinsheng,RAO Tianyu,JIA Qian,et al. Interpolation algorithm based on improved adaptive shock filter in image super-resolution[J]. Chinese Journal of Computers,2015,38(6):1131-1139.
[14]何林阳,刘晶红,李刚.基于多相组重建的航空图像超分辨率算法[J].物理学报,2015,64(11):114201-114208.HE Linyang,LIU Jinghong,LI Gang. Super-resolution of aerial image by means of polyphase components reconstruction[J].Acta Physica Sinica,2015,64(11):114201-114208.
[15]朱红,宋伟东,谭海,等.多尺度细节增强的遥感影像超分辨率重建[J].测绘学报,2016,45(9):1081-1088.ZHU Hong,SONG Weidong,TAN Hai,et al. Remote sensing images super resolution reconstruction based on multi-scale detail enhancement[J]. Acta Geodaetica et Cartographica Sinica,2016,45(9):1081-1088.
[16]张岩,李建增,李德良,等.无人机侦察视频超分辨率重建方法[J].中国图象图形学报,2016,21(7):967-976.ZHANG Yan,LI Jianzeng,LI Deliang,et al. Super-resolution reconstruction for UAV video[J]. Journal of Image and Graphics,2016,21(7):967-976.
[17]李玲慧,杜军平,梁美玉,等.基于时空特征和神经网络的视频超分辨率算法[J].北京邮电大学学报,2016,39(4):1-6.LI Linghui,DU Junping,LIANG Meiyu,et al. Video super-resolution algorithm based on spatial-temporal feature and neural network[J]. Journal of Beijing University of Posts and Telecommunications,2016,39(4):1-6.
[18]YU Jifei,GAO Xinbo,TAO Dacheng,et al. A unified learning framework for single image super-resolution[J]. IEEE Transactions on Neural Networks and Learning Systems,2014,25(4):780-792.
[19]GU Shuhang,ZUO Wangmeng,XIE Qi,et al. Convolutional sparse coding for image super-resolution[C]//2015 IEEE International Conference on Computer Vision(ICCV),2015:1823-1831.
[20]HU Weiming,LI Wei,ZHANG Xiaoqin,et al. Single and multiple object tracking using a multi-feature joint sparse representation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2015,37(4):816-833.
[21]ZADEH L. Fuzzy logic=computing with words[J]. IEEE Transactions on Fuzzy Systems,1996,4(2):103-111.
[22]QIAN Yuhua,CHENG Honghong,WANG Jieting,et al. Grouping granular structures in human granulation intelligence[J].Information Sciences,2017,382(1):150-169.
[23]张铃,张钹.模糊相容商空间与模糊子集[J].中国科学:信息科学,2011,41(1):1-11.ZHANG Ling,ZHANG Bo. Fuzzy tolerance quotient spaces and fuzzy subsets[J]. Science China Information Sciences,2011,41(1):1-11.
[2]张帆,付慧,杨刚.低空林地航拍图像拼接的改进缝合线算法[J].北京林业大学学报,2018,40(5):90-102.ZHANG Fan,FU Hui,YANG Gang. Improved optimal seamless-line algorithm of aerial image mosaic in low altitude woodland[J]. Journal of Beijing Forestry University,2018,40(5):90-102.
[3]陈苏婷,王卓,王奇.基于非线性尺度空间的航拍场景分类[J].上海交通大学学报,2017,51(10):1228-1234.CHEN Suting,WANG Zhuo,WANG Ji. Aerial scene classification based on nonlinear scale space[J]. Journal of Shanghai Jiaotong University,2017,51(10):1228-1234.
[4]孔颖,孙明轩,陆慧娟.多幅混合数字图像提取的迭代学习方法[J].小型微型计算机系统,2017,38(3):584-589.KONG Ying,SUN Mingxuan,LU Huijuan. Iterative learning method for extraction of digital images under multi-blending[J].Journal of Chinese Computer Systems,2017,38(3):584-589.
[5]田娟秀,刘国才,谷珊珊,等.医学图像分析深度学习方法研究与挑战[J].自动化学报,2018,44(3):401-424.TIAN Juanxiu,LIU Guocai,GU Shanshan,et al. Deep learning in medical image analysis and its challenges[J]. Acta Automatica Sinica,2018,44(3):401-424.
[6]尚存,李国梁,马文鹏,等.一种基于Arnold技术的彩色图像数字水印算法研究[J].信阳师范学院学报(自然科学版),2018,31(3):484-488.SHANG Cun,LI Guoliang,MA Wenpeng,et al. Research of digital watermarking algorithm of color image watermark embedded based on Arnold transformation[J]. Journal of Xinyang Normal University(Natural Science Edition),2018,31(3):484-488.
[7]BETZIG E,PATTERSON G H,SOUGRAT R,et al. Imaging intracellular fluorescent proteins at nanometer resolution[J].Science,2006,313(5793):1642-1645.
[8]ROWEIS S T,SAUL L K. Nonlinear dimensionality reduction by locally linear embedding[J]. Science(New York,N Y),2000,290(550):2323-2326.
[9]YANG Jianchao,WRIGHT J,HUANG T S,et al. Image super-resolution via sparse representation[J]. IEEE Transactions on Image Processing,2010,19(11):2861-2873.
[10]PELEG T,ELAD M. A statistical prediction model based on sparse representations for single image super-resolution[J].IEEE Transactions on Image Processing,2014,23(6):2569-2582.
[11]SHIN D K,MOON Y S. Super-resolution image reconstruction using wavelet based patch and discrete wavelet transform[J].Journal of Signal Processing Systems for Signal Image and Video Technology,2015,81(1):71-81.
[12]樊子德,龚健雅,刘博,等.顾及时空异质性的缺失数据时空插值方法[J].测绘学报,2016,45(4):458-465.FAN Zide,GONG Jianya,LIU Bo,et al. A space-time interpolation method of missing data based on spatio-temporal heterogeneity[J]. Acta Geodaetica et Cartographica Sinica,2016,45(4):458-465.
[13]肖进胜,饶天宇,贾茜,等.改进的自适应冲击滤波图像超分辨率插值算法[J].计算机学报,2015,38(6):1131-1139.XIAO Jinsheng,RAO Tianyu,JIA Qian,et al. Interpolation algorithm based on improved adaptive shock filter in image super-resolution[J]. Chinese Journal of Computers,2015,38(6):1131-1139.
[14]何林阳,刘晶红,李刚.基于多相组重建的航空图像超分辨率算法[J].物理学报,2015,64(11):114201-114208.HE Linyang,LIU Jinghong,LI Gang. Super-resolution of aerial image by means of polyphase components reconstruction[J].Acta Physica Sinica,2015,64(11):114201-114208.
[15]朱红,宋伟东,谭海,等.多尺度细节增强的遥感影像超分辨率重建[J].测绘学报,2016,45(9):1081-1088.ZHU Hong,SONG Weidong,TAN Hai,et al. Remote sensing images super resolution reconstruction based on multi-scale detail enhancement[J]. Acta Geodaetica et Cartographica Sinica,2016,45(9):1081-1088.
[16]张岩,李建增,李德良,等.无人机侦察视频超分辨率重建方法[J].中国图象图形学报,2016,21(7):967-976.ZHANG Yan,LI Jianzeng,LI Deliang,et al. Super-resolution reconstruction for UAV video[J]. Journal of Image and Graphics,2016,21(7):967-976.
[17]李玲慧,杜军平,梁美玉,等.基于时空特征和神经网络的视频超分辨率算法[J].北京邮电大学学报,2016,39(4):1-6.LI Linghui,DU Junping,LIANG Meiyu,et al. Video super-resolution algorithm based on spatial-temporal feature and neural network[J]. Journal of Beijing University of Posts and Telecommunications,2016,39(4):1-6.
[18]YU Jifei,GAO Xinbo,TAO Dacheng,et al. A unified learning framework for single image super-resolution[J]. IEEE Transactions on Neural Networks and Learning Systems,2014,25(4):780-792.
[19]GU Shuhang,ZUO Wangmeng,XIE Qi,et al. Convolutional sparse coding for image super-resolution[C]//2015 IEEE International Conference on Computer Vision(ICCV),2015:1823-1831.
[20]HU Weiming,LI Wei,ZHANG Xiaoqin,et al. Single and multiple object tracking using a multi-feature joint sparse representation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2015,37(4):816-833.
[21]ZADEH L. Fuzzy logic=computing with words[J]. IEEE Transactions on Fuzzy Systems,1996,4(2):103-111.
[22]QIAN Yuhua,CHENG Honghong,WANG Jieting,et al. Grouping granular structures in human granulation intelligence[J].Information Sciences,2017,382(1):150-169.
[23]张铃,张钹.模糊相容商空间与模糊子集[J].中国科学:信息科学,2011,41(1):1-11.ZHANG Ling,ZHANG Bo. Fuzzy tolerance quotient spaces and fuzzy subsets[J]. Science China Information Sciences,2011,41(1):1-11.