Hybrid fusion and interpolation algorithm with near-infrared image

详细信息    查看全文

• 作者：Xiaoyan Luo ; Jun Zhang ; Qionghai Dai
• 关键词：image fusion ; color filter array (CFA) ; interpolation ; demosaicing
• 刊名：Frontiers of Computer Science in China
• 出版年：2015
• 出版时间：June 2015
• 年：2015
• 卷：9
• 期：3
• 页码：375-382
• 全文大小：701 KB
• 参考文献：1.Guarnera M, Messina G, Tomaselli V. Adaptive color demosaicing and false color removal. Journal of Electronic Imaging, 2010, 19(2): 1鈥?6View Article
  2.Menon D, Andriani S, Calvagno G. Demosaicing with directional filtering and a posteriori decision. IEEE Transactions on Image Processing, 2007, 16(1): 132鈥?41View Article MathSciNet
  3.Su C Y, Kao W C. Effective demosaicing using subband correlation. IEEE Transactions on Consumer Electronics, 2009, 55(1): 199鈥?04View Article
  4.Chung K H, Chan Y H. Low-complexity color demosaicing algorithm based on integrated gradients. Journal of Electronic Imaging, 2010, 19(2): 1鈥?5View Article
  5.Itoh Y. Similarity-based demosaicing algorithm using unified highfrequency map. IEEE Transactions on Consumer Electronics, 2011, 57(2): 597鈥?05View Article
  6.Hirakawa K, Parks T W. Adaptive homogeneity-directed demosaicing algorithm. IEEE Transactions on Image Processing, 2005, 14(3): 360鈥?69View Article
  7.Wu X, Zhang N. Primary-consistent soft-decision color demosaicking for digital cameras. IEEE Transactions on Image Processing, 2004,13(9): 1263鈥?274View Article
  8.Gunturk B K, Altunbasak Y, Mersereau R M. Color plane interpolation using alternating projections. IEEE Transactions on Image Process, 2002, 11(9): 997鈥?013View Article
  9.Lian N, Chang L, Tan Y, Zagorodnov V. Adaptive filtering for color filter array demosaicking. IEEE Transactions on Image Processing, 2007,16(10): 2515鈥?525View Article MathSciNet
  10.Lu Y M, Karzand M, Vetterli M. Demosaicking by alternating projections: theory and fast one-step implementation. IEEE Transactions on Image Processing, 2010, 19(8): 2085鈥?098View Article MathSciNet
  11.Bennett E P, Mason J L, McMillan L. Multispectral bilateral video fusion. IEEE Transactions on Image Processing, 2007, 16(5): 1185鈥?194View Article MathSciNet
  12.Zhang X, Sim T, Miao X. Enhancing photographs with near infrared images. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2008, 1鈥?
  13.Schaul L, Fredembach C, S眉sstrunk S. Color image dehazing using near-infrared. In: Proceedings of the 16th IEEE International Conference on Image Processing. 2009, 1629鈥?632
  14.S眉sstrunk S, Fredembach C, Tamburrino D. Automatic skin enhancement with visible and near-infrared image fusion. In: Proceedings of the International Conference on Multimedia. 2010, 1693鈥?696
  15.Fredembach C, S眉sstrunk S. Illuminant estimation and detection using near-infrared. In: Proceedings of the International Society for Optics and Photonics Digital Photography. 2009
  16.Salamati N, Fredembach C, S眉sstrunk S. Material classification using color and NIR images. In: Proceedings of the 17th Color Imaging Conference Final Program and Proceedings. 2009, 216鈥?27
  17.Fredembach C, S眉sstrunk S. Colouring the near-infrared. In: Proceedings of the 16th Color Imaging Conference Final Program and Proceedings. 2008, 176鈥?82
  18.Krishnan D, Fergus R. Dark flash photography. ACM Transactions on Graphics, 2009, 28(3), Artile No. 96
  19.Matsui S, Okabe T, Shimano M, Sato Y. Image enhancement of lowlight scenes with near-infrared flash images. Lecture Notes in Computer Science, 2010, 5994: 213鈥?23View Article
  20.Hirakawa K, Parks TW. Joint demosaicing and denoising. IEEE Transactions on Image Processing, 2006, 15(8): 2146鈥?157View Article
  21.Donoho D L. Sparse components of images and optimal atomic decomposition. Constructive Approximation, 2001, 17(3): 353鈥?82View Article MATH MathSciNet
  22.Donoho D L. Compressed sensing. IEEE Transactions on Information Theory, 2006, 52(4): 1289鈥?306View Article MATH MathSciNet
  23.Wang Y, Yang J, Yin W, Zhang Y. A new alternating minimization algorithm for total variation image reconstruction. SIAM Journal on Imaging Sciences, 2008, 1(3): 248鈥?72View Article MATH MathSciNet
  24.Lu Y M, Fredembach C, Vetterli M, S眉sstrunk S. Designing color filter arrays for the joint capture of visible and near-infrared images. In: Proceedings of the 16th IEEE International Conference on Image Processing. 2009, 3797鈥?800
  25.Smith P R. Bilinear interpolation of digital images. Ultramicroscopy, 1981, 6(2): 201鈥?04View Article
  26.Hamilton J F, Adams J E. Adaptive color plane interpolation in single sensor color electronic camera. US Patent, 5 629 734, 1997-07-29
  
• 作者单位：Xiaoyan Luo (1)
  Jun Zhang (2)
  Qionghai Dai (3)
  
  1. Image Processing Center, School of Astronautics, Beihang University, Beijing, 100191, China
  2. National Key Laboratory of CNS/ATM, School of Electronics and Information Engineering, Beihang University, Beijing, 100191, China
  3. Tsinghua National Laboratory for Information Science and Technology (TNList), Department of Automation, Tsinghua University, Beijing, 100084, China
  
• 刊物类别：Computer Science
• 刊物主题：Computer Science, general
  Chinese Library of Science
  
• 出版者：Higher Education Press, co-published with Springer-Verlag GmbH
• ISSN：1673-7466

文摘

Silicon-based digital cameras can record visible and near-infrared (NIR) information, in which the full color visible image (RGB) must be restored from color filter array (CFA) interpolation. In this paper, we propose a unified framework for CFA interpolation and visible/NIR image combination. To obtain a high quality color image, the traditional color interpolation from raw CFA data is improved at each pixel, which is constrained by the corresponding monochromatic NIR image in gradient difference. The experiments indicate the effectiveness of this hybrid scheme to acquire joint color and NIR information in real-time, and show that this hybrid process can generate a better color image when compared to treating interpolation and fusion separately.