图像超分辨率重建算法研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
在实际应用中,由于成像系统内在硬件设备的限制,人们常常无法获得高分辨率的图像。通过改善硬件设备来提高图像的分辨率代价很高,而且对于特定成像系统短期内很难克服一些技术难题,所以从软件方面来提高图像的分辨率意义重大。图像的超分辨率重建就是指通过数字图像处理的方法从一幅或序列多幅低分辨率观测图像中重建出一幅高分辨率的图像。本文致力于解决当对场景只有一幅低分辨率观测图像的情况下,如何结合图像的一些先验知识,恢复出图像获取时丢失的高频信息,重建出一幅高分辨率的图像。
     本文对基于插值的超分辨率算法进行研究。考虑到传统的基于插值的超分辨方法是建立在图像的连续性假设之上的,虽然实时性非常好,但是重构的高分辨率图像在边缘上的效果不好。本文提出了基于图像局部自相似性的插值算法,我们首先对低分辨率图像进行自适应四叉树分块,然后利用图像在局部区域上表现出的自相似性,对每个局部区域的插值参数进行最小二乘估计,并据此完成插值计算,最后运用小波域投影算子对插值得到的高分辨率图像进行全局优化得到最终的高分辨率图像。本文算法大大改善了传统插值算法在图像边缘上的振铃效应,而且运算效率很高。
     本文对基于最大后验概率(Maximum a Posteriori,MAP)的概率分析超分辨率算法进行研究。基于MAP的概率分析超分辨率算法可以将高分辨率目标的一些先验知识以先验概率密度函数的形式加入到优化问题的正则约束项中,将超分辨率问题转化为随机正则优化问题来求解,有非常好的理论基础,因此基于MAP的的超分辨率算法一直是一个研究的热点。本文将小波域Implicit Markov Random Field (IMRF)模型结合到图像超分辨率算法中来,构造了新的优化目标函数,提出了基于小波域IMRF模型的图像超分辨率算法。本文算法可以很好的克服小波域Hidden Markov Tree (HMT)模型超分辨率算法计算量非常大的缺陷,而且较小波域HMT超分辨率算法能得到更好的超分辨率重建结果。
     本文对基于学习的超分辨率算法进行研究。基于学习的超分辨率算法需要构造低分辨率和高分辨率图像样本库,通过学习样本库得到低分辨率图像和高分辨率图像的内在联系,从而指导图像超分辨率重建。这类算法需要构造样本库,而且最终超分辨率的效果好坏很大程度上依赖于待处理图像和样本库图像之间的相似性。本文利用Haar(?)、波变换细节子块之间相近的自相似性,并运用Bp神经网络方法来估计这种自相似关系,提出了一种结合Haar小波变换和Bp神经网络的自学习的图像超分辨率重构算法。本文算法预测得到的细节子块失真小,能很好的解决边缘保持问题,克服了传统基于学习的算法需要构造训练样本库的问题。
     目前对现实三维场景的深度图像的获取越来越受到大家关注。直接获取场景深度图的设备主要有激光测距扫描仪和飞行时间(Time of Flight, TOF)相机。激光测距扫描仪可以提供准确和密集的深度信息,但是激光测距扫描仪每次只能测量一个点,过大的时间损耗限制了它们的应用。TOF相机运用高速快门,通过探测光脉冲的往返时间来得到目标物的距离,可以同时得到整幅场景的深度信息。很好的克服了激光测距扫描仪的缺陷,但是由于传感器硬件条件的限制,TOF相机得到的深度图像分辨率低,从硬件方面进行改进很难克服一些技术难题,结合图像超分辨率重建的思想从软件方面来提高深度图像的分辨率就非常有价值。
     本文对深度图像的超分辨率重建算法进行研究。考虑到同场景的彩色图像和深度图像之间存在相似一致的不连续性。我们假定同场景的彩色图像和深度图像在局部小窗口内具有近似线性关系,将近似线性关系通过Matting Laplacian矩阵的方式融合到超分辨目标函数的正则约束项中,将深度图超分辨率问题转化为最优化问题来求解,提出基于Matting Laplacian矩阵的深度图超分辨率算法。由于计算Matting Laplacian矩阵非常费时,计算代价较大,接下来我们运用引导图像滤波器来描述同场景彩色图像和深度图像之间局部小窗口内的近似线性关系,提出了基于引导图像滤波的深度图超分辨率算法。考虑到同场景的彩色图像和深度图像在局部小窗口内具有的近似线性关系的假设过于简单,对一些实际的复杂场景,彩色和深度在边缘处并不完全满足这个假设,接下来我们假设同场景的彩色图像和深度图像在局部邻域内具有相同的局部结构特征,进而定义了描述这一特征的局部结构参数模型,并将该参数模型融入到正则约束项中对深度图的局部边缘结构提供约束,提出了基于彩色图像局部结构特征的深度图超分辨率算法。
Image super resolution refers to the reconstruction of a high resolution image from one or a set of blurred low resolution images. Considering that there are many cases only one low resolution image is available, so in this paper, we mainly focus on super resolution from single low resolution input image. The goal of single image super resolution is to estimate a high resolution image from a low resolution input. There are mainly three categories of approach for this problem:interpolation based methods, learning based methods, and statistical reconstruction based methods.
     The interpolation based methods are simple but tend to blur the high frequency details. In this paper, we propose a new interpolation based method. Our approach uses the quad tree segmentation to partition the low resolution image, and takes the edge-directed interpolation to each segmented band of the low resolution image, and then applys a wavelet projection to optimize the high resolution image got from the local interpolation. The experimental results show our interpolation method greatly improves the image edge ringing effects of traditional interpolation algorithm.
     The statistical reconstruction based methods require a probability density function of the data known as a prior image model. Maximum a Posteriori (MAP) is one of the most popular statistical methods, so MAP statistical reconstruction based methods are sparked within this research community. In this paper, we propose a novel image super resolution method based on MAP statistical reconstruction. Our approach takes the wavelet domain Implicit Markov Random Field (IMRF) model as the prior constraint and utilizes the MAP theory to construct the objective function with this model. Furthermore, we employ steepest descent method to optimize this objective function. The experimental results demonstrate that our method obtains the superior performance in comparison with traditional single image super-resolution approaches.
     The learning based methods "hallucinate" high frequency details from a training set of high-resolution/low-resolution image pairs, and this kind of methods highly relies on the similarity between the training set and the test set. It is still unclear how many training examples are sufficient for the generic images. In this paper we propose a new learning based super-resolution method which base on the haar wavelet transform and back-propagation network. Considering the self-similarity between the detail subbands of Haar wavelet decomposition, firstly our approach trains the Back-propagation network to approximate the self-similarity relationship and then uses the trained network to predict the detail subbands of Haar wavelet decomposition.
     Depth image of the real three-dimensional scenes get more and more of our attention. Laser range scanners can provide extremely accurate and dense three-dimensional measurement over a large working volume. But these high quality scanners measure a single point at a time and it limits their applications to static environments only. Recently new time-of-flight sensors have been developed to overcome this limitation. These sensors measure time delay between transmission of a light pulse and detection of the reflected signal on an entire frame once by using extremely faster shutter. Though this technology is promising, in the current generation, these time-of-flight sensors are expensive and very limited in terms of resolution. How to improve the resolution of the depth image is an interesting topic.
     In this paper, given a low resolution depth image as input, we recover a high resolution depth image using a registered and potentially high resolution camera image of the same scene. Based on the fact that discontinuities in range and color tend to co-align, we assume that color image and depth image of the same scene have an approximately linear relationship in the locally within the small window. And we apply Matting Laplacian Matrix to exploit this linear relationship and construct an optimization problem. Furthermore, we employ steepest descent method to optimize this objective function. But, calculating the Matting Laplacian matrix is very time-consuming, so we apply the guided image filter to exploit this linear relationship between the color image and depth image of the same scene. Using guided image filter, we integrate the registered high resolution camera image into the range data and generate an initial high resolution depth image. Moreover, a reconstruction constraint is also used to further improve the quality of the initial high resolution depth image iteratively.
     Taking into account that the assumption of the approximate linear relationship between color image and depth image is too simple, some practical complex scenes, color and depth at the edge do not satisfy this assumption, next we use local structural features of high resolution camera image to construct the regularization term and construct a new optimization problem. Experiments demonstrate that our approach can get excellent high resolution range image in terms of both its spatial resolution and depth precision.
引文
[Aly et al,2005] Aly H, Dubois E. Image Up-Sampling Using Total-Variation Regularization With a New Observation Model[J]. IEEE Transaction on Image Processing,2005,14(10): 1647-1659.
    [Aharon et al,2006] Aharon M, Elad M, Bruckstein A. The K-SVD:An algorithm for designing of overcomplete dictionaries for sparse representation[J]. IEEE Transaction on Signal Processing,2006,54(11):4311-4322.
    [Akhtar et al,2010] Akhtar P, Azhar F. A Single Image Interpolation Scheme for Enhanced Super Resolution in Bio-Medical Imaging[C]. International Conference on Bioinformatics and Biomedical Engineering,2010,1-5.
    [Besl,1989] Besl P. Active optical range imaging sensors[J]. Advances in Machine Vision,1989, 1:1-63.
    [Battle et al,1998] Batlle J, Mouaddib E, Salvi J. Recent progress in coded structured light as a technique to solve the correspondence problem:A survey[J]. Pattern Recogn.1998,31(7): 963-982.
    [Baker et al,2000] Baker S, Kanade T. Limits on super-resolution and how to break them[C]. IEEE Computer Society Conference on Computer Vision and Pattern recognition,2000, 372-379.
    [Beige et al,2000] Belge M, Kilmer M, Miller E. Wavelet Domain Image Restoration with Adaptive Edge-Preserving Regularization[J]. IEEE Transactions on Image Processing,2000, 9(4):597-608.
    [Baker et al,2002] Baker S, Kanade T. Limits on super-resolution and how to break them[J]. IEEE Transactions on Pattern Analysis Machine Intelligence,2002,24(9):1167-1183.
    [Battiato et al,2002] Battiato S, Gallo G, Stanco F. A locally adaptive zooming algorithm for digital images[J]. Image Vision and Computing,2002,20(11):805-812.
    [Bin et al,2003] Bin Tian, Hsu J T, Liu Qiang. A wavelet constrained pocs superresolution algorithm for high resolution image reconstruction from video sequence[C]. IEEE International Conference on Networks and Signal Processing,2003,2:1266-1269.
    [Buades et al,2005] Buades A, Coll B, Morel J. A non-local algorithm for image denoising[C]. IEEE Computer Society Conference on Computer Vision and Pattern recognition,2005,60-65.
    [Babacan et al,2008] Babacan S, Molian R, Katsaggelos A. Total variation super resolution using a variational approach [C]. IEEE International Conference on Image Processing,2008, 641-644.
    [Bhavsar et al,2008] Bhavsar A, Rajagopalan A. Resolution enhancement for binocular stereo[C]. IEEE International Conference on Pattern Recognition,2008,1-4.
    [Crouse et al,1998] Crouse M, Nowak R, Baraniuk R. Wavelet-based statistical signal processing using hidden markov models[J]. IEEE Transactions on Signal Processing,1998,46(4): 886-902.
    [Carey et al,1999] Carey W, Chuang D, Hemami S. Regularity-Preserving Image Interpolation[J]. IEEE Transactions on Image Processing,1999,8(9):1293-1297.
    [Chan et al,2001] Chan T, Osher S, Shen J. The Digital TV Filter and Nonlinear Denoising[J]. IEEE Transactions on Image Processing,2001,10 (2):231-241.
    [Choi et al,2001] Choi H, Baraniuk R. Multiscale Image Segmentation Using Wavelet-Domain Hidden Markov Models[J]. IEEE Transactions on Image Processing,2001,10 (9):1309-1321.
    [Chambolle,2004] Chambolle A. An Algorithm for Total Variation Minimization and Applications[J]. Journal of Mathematical Imaging and Vision,2004,20:89-97.
    [Chang et al,2004] Chang H, Yeung D, Xiong Y. Super-resolution through neighbor embedding[C]. IEEE Computer Society Conference on Computer Vision and Pattern recognition,2004,1:275-282.
    [Chang et al,2006] Chang S G, Cvetkovic Z, Vetterli M. Locally adaptive wavelet-based image interpolation[J]. IEEE Transactions on Image Processing,2006,15(6):1471-1485.
    [Chen et al,2009] Chen Jia, Tang C, Wang Jue. Noise Brush:Interactive High Quality Image-noise Separation. ACM Transaction on Graphics,2009,28(5):1-10.
    [Cholsu et al,2011] Cholsu K, Yu H, Yang G. Depth super resolution using bilateral filter[C]. International Congress on Image and Signal Processing,2011,2:1067-1071.
    [Cheung et al,2011] Cheung G, Ishida J, Kubota A, et al. Transform domain sparsification of depth maps using iterative quadratic programming[C]. IEEE International Conference on Image Processing,2011,129-132.
    [Canesta EP Devkit] Canestavision electronic perception development kit, canesta inc. \\http://www.canesta.com/.
    [Daubechies,1992] Daubechies I. Ten lectures on wavelets[M]. SIAM Press, Philadelphia,1992.
    [Diebel et al,2006] Diebel J, Thrun S. An application of Markov random fields to range sensing[J]. Advances in Neural Information Processing Systems,2006,18:291-298.
    [Dai et al,2007a] Dai S, Han M, Wu Y, et al. Bilateral Back-Projection for Single Image Super Resolution[C]. IEEE International Conference on Multimedia and Expo,2007,1039-1042.
    [Dai et al,2007b] Dai S, Han M, Xu W, et al. Soft edge smoothness prior for alpha channel super resolution[C]. IEEE Computer Society Conference on Computer Vision and Pattern recognition, 2007,1-8.
    [Dai et al,2009] Dai S, Han M, Xu W, et al. SoftCuts:A Soft Edge Smoothness Prior for Color Image Super-Resolution[J]. IEEE Transactions on Image Processing,2009,18(5):969-981.
    [Dong et al,2009] Dong W, Zhang L, Shi G, Wu X. Nonlocal back-projection for adaptive image enlargement[C]. IEEE International Conference on Image Processing,2009,349-352
    [Dong et al,2010] Dong W, Shi G, Zhang L, Wu X. Super-resolution with Nonlocal Regularized Sparse Representation[C]. Visual Communications and Image Processing,2010.
    [Dolson et al,2010] Dolson J, Baek J, Plagemann C, al et. Upsampling Range Data in Dynamic Environments [C]. IEEE Computer Society Conference on Computer Vision and Pattern recognition,2010,1-8.
    [Elad et al,1997] Elad M, Feuer A. Restoration of single super-resolution image from several blurred, noisy and down-sampled measured images[J] IEEE Transactions on Image Processing, 1997,6:1646-1658.
    [Elad et al,2006a] Elad M, Aharon M. Image denoising via learned dictionaries and sparse representation[C]. IEEE Computer Society Conference on Computer Vision and Pattern Recognition,2006,17-22.
    [Elad et al,2006b] Elad M, Aharon M. Image denoising via sparse and redundant representations over learned dictionaries[J]. IEEE Transactions on Image Processing,2006,15(12),3736-3745.
    [Edeler et al,2009] Edeler T, Ohliger K, Hussmana S, Mertins A. Super resolution of time-of-flight depth images under consideration of spatially varying noise variance[C]. IEEE International Conference on Image Processing,2009,1185-1188.
    [Edeler et al,2011] Edeler T, Ohliger K, Hussmana S, Mertins A. Super resolution reconstruction method for Time-of-Flight range data using complex compressive sensing[C]. IEEE Instrumentation and Measurement Technology Conference,2011,1-5.
    [Fan et al,2000] Fan G, Xia X. Wavelet-Based Statistical Image Processing Using Hidden Markov Tree Model[C]. Conference on Information Sciences and Systems,2000.
    [Fruchter et al,2001] Fruchter A, Hook R. Drizzle:A Method for the Linear Reconstruction of Undersampled Images[J]. Publ. Aastron. Soc. Pacific,2001,114:144-152.
    [Freeman et al,2002] Freeman W, Johns T, Pasztor E. Example-based super-resolution[J]. IEEE Computer Graphics and Applications,2002,22(2):56-65.
    [Farsiu et al,2004] Farsiu S, Robinson M, Elad M, Milanfar P. Fast and robust multiframe super-resolution[J]. IEEE Transaction on Image Processing,2004,13(10):1327-1344.
    [Fu et al,2005] Fu Y, Zhang X. Wavelet-based interpolation algorithm for topology extraction of compliant mechanisms[C]. IEEE International Conference on Machine Learning and Cybernetics,2005,5:2802-2807.
    [Fattal,2007] Fattal R. Image upsampling via imposed edge statistics[J]. ACM Transactions on Graphics,2007,26(3):95:1-95:8.
    [Goodman,1968] Goodman W. Introduction to Fourier Optics[M]. Roberts and Company Publishers,1968.
    [Gonzalez et al,2002] Gonzalez R, Woods R. Digital Image Processing[M]. Upper Saddle River, N. J.:Prentice Hall,2002.
    [Glasner et al,2009] Glasner D, Bagon S, Irani M. Super-resolution from a single image [C]. IEEE International Conference on Computer Vision,2009,349-356.
    [Gajjar et al,2010] Gajjar P, Joshi M. New Learning Based Super-Resolution:Use of DWT and IGMRF Prior[J]. IEEE Transactions on Image Processing,2010,19(5):1201-1213.
    [Gilman et al,2010] Gilman A, Bailey D, Marslang S. Least-squares optimal interpolation for fast image super-resolution[C]. IEEE International Symposium on Electronic Design, Test & Applications,2010,29-34.
    [Giachetti et al,2011] Giachetti A, Asuni N. Real-Time Artifact-Free Image Upscaling[J]. IEEE Transaction on Image Processing,2011,20 (10):2760-2768.
    [Gevrekci et al,2011] Gevrekci M, Pakin K. Depth map super resolution[C]. IEEE International Conference on Image Processing,2011,3449-3452.
    [Gao,2012]Gao X, Zhang K, Tao D, et al. Joint Learning for Single-Image Super-Resolution via a Coupled Constraint [J]. IEEE Transaction on Image Processing,2012,21(2):469-480.
    [Hadamard,1923] Hadamard J. Lectures on the Cauchy Problem in Linear Partial Differential Equations[M]. New Haven:Yale University Press,1923.
    [Harris,1964] Harris L. Diffraction and resolving power[J]. Journal of the Optical Society of American,1964,54(7):931-933.
    [Hou et al,1987] Hou H and Andrews H. Cubic splines for image interpolation and digital filtering[J]. IEEE Transactions on Acoustics, Speech and Signal Processing,1987, 26(6):508-517.
    [Huang et al,1999] Huang Y, Chang R. MLP interpolation for digital image processing using wavelet transform[C]. IEEE International Conference on Acoustics, Speech and Signal Processing,1999,6:3217-3220.
    [He et al,2010] He Kaiming, Sun Jian, Tang Xiaoou. Guided Image Filtering[C]. European Conference on Computer Vision,2010,1-14.
    [He et al,2011] He H, Siu W. Single Image Super-Resolution using Gaussian Process Regression [C]. IEEE Computer Society Conference on Computer Vision and Pattern recognition,2011, 449-456.
    [Hu et al,2012] Hu W, Cheung G, Li X, et al. Depth Map Super-Resolution Using Synthesized View Matching for Depth-Image-Based Rendering[C]. IEEE International Conference on Multimedia and Expo Workshops,2012,605-610.
    [Irani et al,1991] M. Irani and S. Peleg. Improving resolution by image registration[J]. CVGIP:Graphical Models and Image Processing,1991,53(3):231-239.
    [Jarvis,1983] Jarvis R. A perspective on range finding techniques for computer vision[J]. IEEE Transactions on Pattern Analysis Machine Intelligence,1983,5(2),122-139.
    [Joshi et al,2006] Joshi M, Chaudhuri S. Simultaneous estimation of super-resolved depth map and intensity field using photometric cue[J]. Computer Vision and Image Understanding,2006, 101:31-44.
    [Ji et al,2009] Ji H, Fermu'ller C. Robust Wavelet-Based Super-Resolution Reconstruction: Theory and Algorithm[J]. IEEE Transactions on Pattern Analysis Machine Intelligence,2009, 31(4),649-660.
    [孔玲莉等,2001]孔玲莉,黄华,齐春等.图像超分辨率研究的最新进展[J].光学技术,2004,30(3):374-377.
    [Keys,1981] Keys R. Cubic convolution interpolation for digital image processing[J]. IEEE Transactions on Acoustics, Speech and Signal Processing,1981,29(6):1153-1160, December.
    [Kinebuchi et Al,2001] Kinebuchi K, Muresan D, Parks T. Image interpolation using wavelet based hidden Markov trees[C]. IEEE International Conference on Acoustics, Speech and Signal Processing,2001,3:1957-1960.
    [Kim et al,2005] Kim S, Eom K, Kim Y. Wavelet-Based Image Interpolation Using Phase-Shift Compensation [C]. IEEE 7th Workshop on Multimedia Signal Processing,2005,1-4.
    [Kil et al,2006] Kil Y, Mederos B, Amenta N. Laser scanner super-resolution[J]. Eurographics Symposium Point-Based Graphics,2006,9-15.
    [Kim et al,2006] Kim H, Kim J, Lee S, Cho N. Interpolation of Multi-Spectral Images In wavelet Domain for Satellite Image Fusion[C]. IEEE International Conference on Image Processing, 2006,1009-1012.
    [Kim et al,2007] Kim S, Eom K, Kim Y. Image Interpolation Based on Statistical Relationship Between Wavelet Subbands[C]. IEEE International Conference on Multimedia and Expo,2007, 1723-1726.
    [Kopf et al,2007] Kopf J, Cohen M, Lischinski D, Uyttendaele M. Joint Bilateral Upsampling[J]. ACM Trans on Graphics,2007,26(3).
    [Kim et al,2008]Kim K, Kwon Y. Example-Based Learning for Single Image Super-Resolution [C] DAGM,2008,456-465.
    [Kim et al,2010] Kim K, Kwon Y. Single-image super-resolution using sparse regression and natural image prior[J] IEEE Transaction on Pattern Analysis and Machine Intelligence,2010, 32(6):1127-1133.
    [Kinect dataset] Kinect dataset. //http://cs.nyu.edu/-silberman/projects/indoor_scene_seg_sup.html/.
    [Lippmann,1987] Lippmann R P. An introduction to computing with neural nets[J]. IEEE ASSP Mag,1987,4:4-22.
    [Li et al,2000] Li Xin, Orchard M T. New edge-directed interpolation [C]. IEEE International Conference on Image Processing,2000,311-314.
    [Li et al,2001a] Li Xin, Orchard M T. Edge-directed prediction for lossless compression of natural images[J]. IEEE Transactions on Image Processing,2001,10(6):813-817.
    [Li et al,2001b] Li Xin, Orchard M T. New edge-directed interpolation[J]. IEEE Transactions on Image Processing,2001,10(10):1521-1527.
    [Lin et al,2004] Lin Z, Shun H. Fundamental Limits of Reconstruction-Based Superresolution Algorithms under Local Translation [J]. IEEE Transactions on Pattern Analysis Machine Intelligence,2004,26(1):83-97.
    [Li et al,2007] Li F, Fraser D, Jia X. Wavelet domain deblurring and denoising for image resolution improvement[C]. IEEE Conference on Digital Image Computing Techniques and Application,2007,373-379.
    [Leung et al,2008] Leung K T, Tong C S. Effective Use of Low Resolution Images for Super-Resolution Reconstruction [C]. International Congress on Image and Signal Processing, 2008,3:320-325.
    [Levin et al,2008] Levin A, Lischinshi D, Weiss Y. A Closed Form Solution to Natural Image Matting. IEEE Transaction on Pattern Analysis and Machine Intelligence,2008,30(2): 228-242.
    [Liang et al,2008] Liang F, Xie K. Classified Image Interpolation Using Neural Networks. IEEE International Joint Conference on Neural Networks,2008,1075-1079.
    [Li et al,2008a] Li F, Jia X, Fraser D. Universal hmt based super resolution for remote sensing images[C]. IEEE International Conference on Image Processing,2008,333-336.
    [Li et al,2008b] Li Feng, Yu Jingyi, Chai Jinxiang. A hybrid camera for motion deblurring and depth map super-resolution[C]. IEEE Computer Society Conference on Computer Vision and Pattern Recognition,2008,1-8.
    [Li et al,2008c] Li C, Cheng K. Image Interpolation with Self-training using Wavelet Transform and Neural Network[C]. IEEE International Conference on Information Technology and Application in Biomedicine,2008,131-134.
    [Li et al,2009] Li B, Chang H, Shan S, et al. Locality preserving constraints for super-resolution with neighbor embedding[C]. IEEE International Conference on Image Processing,2009, 1189-1192.
    [Lyu,2009]Lyu Siwei. An Implicit Markov Random Field Model for the Multi-scale Oriented Representations of Natural Images[C].IEEE Computer Society Conference on Computer Vision and Pattern Recognition,2009,1919-1925.
    [Li et al,2010a] Li F, Jia X, Fraser D. Super Resolution for Remote Sensing Images Based on a Universal Hidden Markov Tree Model[J]. IEEE Transactions on Geoscience and Remote Sensing,2010,48(3):1270-1279.
    [Li et al,2010b] Li H, Xiong H, Qian L. Image super-resolution with sparse representation prior on primitive patches[J]. Visual Communications and Image Processing,2010.
    [Lu et al,2011] Lu Jiangbo, Min D, Pahwa R, Minh N. Do. a revisit to MRF-based depth map super-resolution and enhancement[C]. IEEE International Conference on Acoustics, Speech and Signal Processing,2011,985-988.
    [Li et al,2012] Li Y, Xue T, Sun L, et al. Joint Example-based Depth Map Super-Resolution [C]. IEEE International Conference on Multimedia and Expo,2012,152-157.
    [Middlebury data] Middlebury datasets.\\http://vision.middlebury.edu/stereo/data/.
    [Mallat,1989] Mallat S. A theory for multiresolution signal decomposition:the wavelet representation[J]. IEEE Transactions on Pattern Analysis Machine Intelligence,1989,11(7): 674-693.
    [Mallat,1998] Mallat S. A wavelet tour of signal processing[M]. New York:Academic,1998.
    [Mallat,2010] Mallat S, Yu G. Super-Resolution with Sparse Mixing Estimators[J]. IEEE Transaction on Image Processing,2010,19(11):2889-2900.
    [Malgouyres,2002] Malgouyres F. Minimizing the Total Variation Under a General Convex Constraint for Image Restoration[J]. IEEE Transactions on Image Processing,2002,11(12): 1450-1456.
    [Muresan,2005] Muresan D. Fast Edge Directed Polynomial interpolation [C]. IEEE International Conference on Image Processing,2005,2:Ⅱ-990-3.
    [Merino et al,2007a] Merino M, Nuflez J. Super-Resolution of Remotely Sensed Images With Variable-Pixel Linear Reconstruction[J]. IEEE Transactions on Geoscience and Remote Sensing,2007,45(5):1446-1457.
    [Merino et al,2007b] Merino M, Nuflez J. Super-Resolution of remotely sensed images using SRVPLR and SRASW[C]. IEEE International Geoscience and Remote Sensing Symposium, 2007,4866-4869.
    [Mairal et al,2009] Mairal J, Bach F, Ponce J, et al. Online dictionary learning for sparse coding[C]. Annual International Conference on Machine Learning,2009,689-696.
    [Mairal et al,2009] Mairal J, Bach F, Ponce J, et al. Non-local Sparse Models for Image Restoration[C]. IEEE International Conference on Computer Vision,2009,2272-2279.
    [Min et al,2010] Min D, Lu J, Do M. Depth Video Enhancement Based on Weighted Mode Filtering[J]. IEEE Transactions on Image Processing,2010,1:15.
    [Mu et al,2011] Mu G, Gao X, Zhang K, et al. Single image super resolution with high resolution dictionary[C]. IEEE International Conference on Image Processing,2011,1141-1144.
    [Nguyen et al,2001] Nguyen N, Milanfar P, and Golub G. A computationally efficient image super resolution algorithm[J]. IEEE Transactions on Image Processing,2001,10:573-583.
    [Ni et al,2007] Ni W, Guo B, Yang L. Example based Super-Resolution Algorithm of Video in Contourlet Domain[C]. IEEE International Conference on Image and Graphics,2007,13-19.
    [Nava,2010] Nava F. Super-resolution in plenoptic cameras by the integration of depth from focus and stereo[C]. IEEE International Conference on Computer Communications and Networks,2010,1-6.
    [Ozkan et al,1994] Ozkan M, Tekalp M, Sezan I. POCS-based restoration of space-varying blurred images[J]. IEEE Transactions on Image Processing,1994,3(4):450-454.
    [浦剑等,2010]浦剑,张军平.在小波域内实现图像的超分辨率复原[J].模式识别与人工智能,2010,23(3):335-340.
    [Patti et al,1977] Patti J, Sezan I, Tekalp M. Super-resolution video reconstruction with arbitrary sampling latticesand nonzero aperture time[J]. IEEE Transactions on Image Processing,1977, 6(8):1064-1076.
    [Poussart et al,1989] Poussart D, Laurendeau D.3-D sensing for industrial computer vision[J]. in Advances in Machine Vision,1989,3:122-159.
    [Plaziac,1999] Plaziac N. Image interpolation using neural networks[J]. IEEE Transactions on Image Processing,1999,8(11):1647-1651.
    [Park et al,2003] Park S, Park M, Kang M. Super-resolution Image Reconstruction:a technical review[J]. IEEE Signal Processing Magazine,2003,5(21):21-36.
    [Peyre et al,2008] Peyre D, Bougleux S, Cohen L. Non-local Regularization of Inverse Problems [C]. European Conference on Computer Vision,2008,57-68.
    [Protter et al,2009] Protter M, Elad M, Takeda H. Generalizing the Non-Local-Means to. Super-resolution Reconstruction[J]. IEEE Transactions on Image Processing,2009, 18(1):36-51.
    [Park et al,2011] Park J, Kim H, Tai Y, et al. High Quality Depth Map Upsampling for 3D-TOF Cameras [C]. IEEE International Conference on Computer Vision,2011,1-8.
    [PMD Technologies Camcube 2.0] PMD Technologies Camcube 2.0.\\http://www.pmdtec.com/.
    [Rudin et al,1992] Rudin L, Osher S, and Fatemi E. Nonlinear total variation based noise removal algorithms[C] Phys. D,1992,60(4):259-268.
    [Rom berg et al,2001] Romberg J, Choi H, Baraniuk R. Bayesian tree-structured image modeling using wavelet-domain hidden-Markov models[J]. IEEE Transactions on Image Processing, 2001,10(7):1056-1068.
    [Rajan et al,2001] Rajan D, Chaudhuri S. Simultaneous estimation of super-resolved intensity and depth maps from low resolution defocused observations of a scene[C]. IEEE International Conference on Computer Vision,2001,1:113-118.
    [Rajan et al,2003] Rajan D, Chaudhuri S. Simultaneous estimation of super-resolved scene and depth map from low resolution defocused observations[J].IEEE Transactions on Pattern Analysis Machine Intelligence,2003,25(9):1102-1117.
    [Rasmussen,2006] C. E. Rasmussen and C. K. I. Williams. Gaussian Processes for Machine Learning[M]. The MIT Press,1 edition,2006.
    [Rosenbush,2007] Rosenbush G, Hong T, Eastman R. Super-resolution enhancement of flash LADAR range data[J]. SPIE,2007,6736:1-14.
    [Rubinstein et al,2008] Rubinstein R, Zibulevsky M, Elad M. Efficient Implementation of the K-SVD Algorithm using Batch Orthogonal Matching Pursuit[J]. Technical Report-CS Technion,2008.
    [Rajagopalan et al,2008] Rajagopalan A, Bhavsar A, Wallhoff F, Rigoll G. Resolution enhancement of PMD range maps[J]. Lecture Notes in Computer Science,2008,5096,304-313.
    [Rubinstein et al,2010] Rubinstein R, Zibulevsky M, Elad M. Double Sparsity:Learning Sparse Dictionaries for Sparse Signal Approximation [J]. IEEE Transactions on Signal Processing, 2010,58(3):1553-1564.
    [Reji et al,2010] Reji A, Tessamma T. A Learning Based Single Image Super Resolution Method Using Directionlets[C]. International Conference on Advances in Computer Engineering,2010, 69-73.
    [苏秉华等,2001]苏秉华,金伟其,牛丽红等.超分辨率图像复原极其进展[J].光学技术,2001,27(1):6-9.
    [Stark et al,1989] Stark H, Oskoui P. High-resolution image recovery from image-planear rays, using convex projections[J]. Journal of the Optical Society of American,1989,6(11): 1715-1726.
    [Starck et al,1994] Starck J L, Murtagh F. Image restoration with noise suppression using the wavelet transform[J]. Astronomy and Astrophysics,1994,288:342-350.
    [Su et al,2002] Su Binghua, Jin Weiqi, Niu Lihong, et al. Poisson-MAP super-resolution image restoration algorithm with Markov constraint [J]. Acta Photonica Sinica,2002,31(4):492-496.
    [Sun et al,2003] Sun J, Zheng N, Tao H, et al. Image hallucination with primal sketch priors[C]. IEEE Computer Society Conference on Computer Vision and Pattern Recognition,2003,2: 729-736.
    [Salvi et al,2004] Salvi J, Pages J, Batlle J. Pattern Codification Strategies in Structured Light Systems[J]. Pattern Recognition,2004,37:827-849.
    [Su et al,2006] Su W, Ward R. An Edge-based Image Interpolation Approach Using Symmetric Biorthogonal Wavelet Transform[C]. IEEE 8th Workshop on Multimedia Single Processing, 2006,355-359.
    [Schuon et al,2008] Schuon S, Theobalt C, Davis J, Thrun S. High-quality Scanning using Time-of-flight Depth Super-resolution[C]. IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops,2008,1-7.
    [Suekate et al,2008] Suekate N, Sakano M, Uchino E. Image Super-resolution Based on Local Self-similarity [J]. Optical Review,2008,15(1):26-30.
    [Sun et al,2008] Sun J, Sun J, Xu Z, et al. Image Super-Resolution using Gradient Profile Prior[J]. IEEE Computer Society Conference on Computer Vision and Pattern Recognition,2008,1-8.
    [Schuon et al,2009] Schuon S, Theobalt C, Davis J, Thrun. S. LidarBoost:Depth Super-resolution for ToF 3D Shape Scanning[C]. IEEE Computer Society Conference on Computer Vision and Pattern Recognition,2009,343-350.
    [Sun et al,2011] Sun J, Sun J, Xu Z, et al. Gradient Profile Prior and Its Applications in Image Super-Resolution and Enhancement[J]. IEEE Transactions on Image Processing,2011,20(6): 1529-1542.
    [Swiss Ranger 4000] MESA Imaging. Swiss Ranger SR-4000.\\http://www.mesa-imaging.ch/.
    [Tsai et al,1984] Tsai R, Huang T. Multiframe image restoration and registration[J]. Compute Vision and Image Processsing,1984,317-339.
    [Tomasi et al,1998] Tomasi C, Manduchi R. Bilateral Filtering for Gray and Color Images[C]. IEEE International Conference on Computer Vision,1998,839-846.
    [Tu et al,2005] Tu G, Zhang C, Wu J, et al. Remote sensing image processing using wavelet fractal interpolation[C]. IEEE International Conference on Communication, Circuits and Systems,2005,2:701-706.
    [Tong et al,2006] Tong C S, Leung K T. Super-resolution reconstruction using haar wavelet estimation[M]. In Wavelet Analysis and Applications, Springer Book Series on Applied and Numerical Harmonic Analysis, Birkhauser Verlag Basel,2006,419-430.
    [Temizel et al,2006] Temizel A, Vlachos T. Wavelet domain image resolution enhancement[J]. IEE Proceedings Vision, Image and Signal Processing,2006,153(1):25-30.
    [Tafti et al,2006] Tafti P, Shirani S, Wu X. On Interpolation and Resampling of Discrete Data[J]. IEEE Signal Processing Letters,2006,13(12):733-736.
    [Tong et al,2007] Tong C S, Leung K T. Super-resolution reconstruction based on linear interpolation of wavelet coefficients [J]. Special Issue of the International Journal on Multidimensional Systems and Signal Processing,2007,18(2-3):153-171.
    [Tai et al,2010] Tai Y, Liu S, Brown M, et al. Super Resolution using Edge Prior and Single Image Detail Synthesis [J]. IEEE Computer Society Conference on Computer Vision and Pattern Recognition,2010,2400-2407.
    [Tang et al,2011] Tang Y, Yuan Y, Yan P, et al. Single-image super-resolution based on semi-supervised learning [C]. Asian Conference on Pattern Recognition,2011,52-56.
    [Vincent et al,2002] Vincent P, Bengio Y. Kernel Matching Pursuit[J]. Machine Learning,48: 165-187,2002.
    [Wildeboer et al,2011] Wildeboer M, Yendo T, Tehrani M, et al. Depth up-sampling for depth coding using view information[C].3DTV Conference,2011,1-4.
    [Xiang et al,2010] Xiang Xueqin, Li Guangxia, Tong Jing, Pan Zhigeng. Fast and Simple Super-resolution for Range Data[C] International Conference on Cyberworlds. Singapore, 2010,319-324.
    [Yang et al,2007] Yang Qingxiong, Yang Ruigang, Davis J, Nister D. Spatial-depth Super-resolution for Range Images[C]. EEEE Computer Society Conference on Computer Vision and Pattern Recognition,2007,1-8.
    [Yang et al,2008] Yang J, Wright J, Huang T, Ma Y. Image super-resolution as sparse representation of raw image patches[C]. IEEE Computer Society Conference on Computer Vision and Pattern Recognition,2008,1-8.
    [Yasuno et al,2008] Yasuno H, Chiracharit W, Chamnongthai k. Image interpolation by Estimation and Deconvolution of Haar Wavelet Approximate Subband[C]. International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology,2008,1:501-504.
    [Yasuno et al,2008] Yasuno H, Chiracharit W, Chamnongthai k. Image interpolation by Estimation and Deconvolution of Wavelet Approximate Subband[C]. International Symposium on Communications and Information Technologies,2008,154-159.
    [Yang et al,2010] Yang J, Wright J, Huang T, Ma Y. Image super-resolution via sparse representation[J]. IEEE Transactions on Image Processing,2010,19(11):61-73.
    [Yang et al,2012] Yang Yuxiang, Wang Zengfu. Range Image Super-resolution via Guided Image Filter[C]. ACM International Conference on Internet Multimedia Computing and Service, 2012,200-203.
    [赵书斌等,2003a]赵书斌,张蓬,彭思龙.基于小波域LS方法的图象超分辨率重构算法[J].中国图象图形学报,2003,8(11):1281-1285.
    [赵书斌等,2003b]赵书斌,彭思龙.基于小波域HMT模型的图象超分辨率重构[J].计算机辅助设计与图形学学报,2003,15(11):1347-1352.
    [赵书斌等,2004]赵书斌,张蓬,彭思龙.基于小波域HMT模型的彩色图像超分辨率复原[J].中国图象图形学报,2004,9(2):172-177.
    [张新明等,2003]张新明,沈兰荪.在小波域内实现图像的超分辨率复原[J].计算机学报,2003,26(9):1183-1189.
    [张玉宝等,2010]张玉宝,韦志辉,肖亮等.多形态稀疏性正则化的图像超分辨率算法[J].电子学报,2010,38(12):2898-2903.
    [Zhu et al,2001] Zhu Y, Schwartz S, Orchard M. Wavelet domain image interpolation via statistical estimation[C]. IEEE International Conference on Image Processing,2001,3:840-843.
    [Zhao et al,2003] Zhao S, Han H, Peng S. Wavelet-domain hmt-based image super-resolution[C]. IEEE International Conference on Image Processing,2003,53-956.
    [Zhang et al,2011] Zhang Xudong, Shen Yuliang, Hu Liangmei. Super resolution reconstruction algorithm for PMD range image based on regularization[C]. International Conference on Intelligent Human-Machine Systems and Cybernetics,2011,15-18.
    [Z-cam]Z-cam,3dv systems.\\http://www.3dvsystems.com/home/index.html

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700