Parallax correction via disparity estimation in a multi-aperture camera

详细信息    查看全文

• 作者：Janne Mustaniemi ; Juho Kannala ; Janne Heikkilä
• 关键词：Mutual information ; Census transform ; Trifocal tensor ; Graph cuts ; Semi ; global matching
• 刊名：Machine Vision and Applications
• 出版年：2016
• 出版时间：November 2016
• 年：2016
• 卷：27
• 期：8
• 页码：1313-1323
• 全文大小：
• 刊物类别：Computer Science
• 刊物主题：Pattern Recognition; Image Processing and Computer Vision; Communications Engineering, Networks;
• 出版者：Springer Berlin Heidelberg
• ISSN：1432-1769
• 卷排序：27

文摘

In this paper, an image fusion algorithm is proposed for a multi-aperture camera. Such camera is a feasible alternative to traditional Bayer filter camera in terms of image quality, camera size and camera features. The camera consists of several camera units, each having dedicated optics and color filter. The main challenge of a multi-aperture camera arises from the fact that each camera unit has a slightly different viewpoint. Our image fusion algorithm corrects the parallax error between the sub-images using a disparity map, which is estimated from the single-spectral images. We improve the disparity estimation by combining matching costs over multiple views using trifocal tensors. Images are matched using two alternative matching costs, mutual information and Census transform. We also compare two different disparity estimation methods, graph cuts and semi-global matching. The results show that the overall quality of the fused images is near the reference images.