Recovering Scene Geometry under Wavy Fluid via Distortion and Defocus Analysis

详细信息    查看全文

• 作者：Mingjie Zhang (19)
  Xing Lin (19)
  Mohit Gupta (20)
  Jinli Suo (19)
  Qionghai Dai (19)
  
• 关键词：underwater 3D reconstruction ; dynamic fluid surface recovery ; refractive blur ; distortion ; depth from defocus
• 刊名：Lecture Notes in Computer Science
• 出版年：2014
• 出版时间：2014
• 年：2014
• 卷：8693
• 期：1
• 页码：234-250
• 全文大小：9,102 KB
• 参考文献：1. Agrawal, A., Chellappa, R., Raskar, R.: An algebraic approach to surface reconstruction from gradient fields. In: ICCV, vol.聽1, pp. 174鈥?81. IEEE (2005)
  2. Agrawal, A., Raskar, R., Chellappa, R.: What is the range of surface reconstructions from a gradient field? In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006, Part I. LNCS, vol.聽3951, pp. 578鈥?91. Springer, Heidelberg (2006) CrossRef
  3. Alterman, M., Schechner, Y., Perona, P., Shamir, J.: Detecting motion through dynamic refraction. PAMI聽35(1), 245鈥?51 (2013) CrossRef
  4. Alterman, M., Schechner, Y.Y., Swirski, Y.: Triangulation in random refractive distortions. In: ICCP, pp. 1鈥?0. IEEE (2013)
  5. Ben-Ezra, M., Nayar, S.K.: What does motion reveal about transparency? In: ICCV, pp. 1025鈥?032. IEEE (2003)
  6. Brox, T., Bregler, C., Malik, J.: Large displacement optical flow. In: CVPR, pp. 41鈥?8. IEEE (2009)
  7. Brox, T., Bruhn, A., Papenberg, N., Weickert, J.: High accuracy optical flow estimation based on a theory for warping. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol.聽3024, pp. 25鈥?6. Springer, Heidelberg (2004) CrossRef
  8. Chang, Y.-J., Chen, T.: Multi-view 3d reconstruction for scenes under the refractive plane with known vertical direction. In: ICCV, pp. 351鈥?58. IEEE (2011)
  9. Ding, Y., Li, F., Ji, Y., Yu, J.: Dynamic fluid surface acquisition using a camera array. In: ICCV, pp. 2478鈥?485. IEEE (2011)
  10. Donate, A., Ribeiro, E.: Improved reconstruction of images distorted by water waves. In: Advances in Computer Graphics and Computer Vision, pp. 264鈥?77. Springer, Heidelberg (2007) CrossRef
  11. Efros, A., Isler, V., Shi, J., Visontai, M.: Seeing through water. In: NIPS, vol.聽17, pp. 393鈥?00 (2005)
  12. Favaro, P.: Recovering thin structures via nonlocal-means regularization with application to depth from defocus. In: CVPR, pp. 1133鈥?140. IEEE (2010)
  13. Favaro, P., Soatto, S.: 3D shape reconstruction and image restoration: exploiting defocus and motion blur. Springer Verlag (2006)
  14. Ferreira, R., Costeira, J.P., Santos, J.A.: Stereo reconstruction of a submerged scene. In: Marques, J.S., P茅rez de la Blanca, N., Pina, P. (eds.) IbPRIA 2005. LNCS, vol.聽3522, pp. 102鈥?09. Springer, Heidelberg (2005) CrossRef
  15. Gupta, M., Narasimhan, S.G., Schechner, Y.Y.: On controlling light transport in poor visibility environments. In: CVPR, pp. 1鈥?. IEEE (2008)
  16. Hirschmuller, H., Scharstein, D.: Evaluation of cost functions for stereo matching. In: CVPR, pp. 1鈥?. IEEE (2007)
  17. Huynh, C.P., Robles-Kelly, A., Hancock, E.: Shape and refractive index recovery from single-view polarisation images. In: CVPR, pp. 1229鈥?236. IEEE (2010)
  18. Ihrke, I., Goidluecke, B., Magnor, M.: Reconstructing the geometry of flowing water. In: ICCV, vol.聽2, pp. 1055鈥?060. IEEE (2005)
  19. J盲hne, B., Klinke, J., Waas, S.: Imaging of short ocean wind waves: a critical theoretical review. JOSA A聽11(8), 2197鈥?209 (1994) CrossRef
  20. Kidger, M.J.: Fundamental optical design, vol.聽92. SPIE Press Bellingham, Washington, DC (2002)
  21. Lin, X., Suo, J., Cao, X., Dai, Q.: Iterative feedback estimation of depth and radiance from defocused images. In: Lee, K.M., Matsushita, Y., Rehg, J.M., Hu, Z. (eds.) ACCV 2012, Part IV. LNCS, vol.聽7727, pp. 95鈥?09. Springer, Heidelberg (2013) CrossRef
  22. Morris, N.J., Kutulakos, K.N.: Dynamic refraction stereo. In: ICCV, vol.聽2, pp. 1573鈥?580. IEEE (2005)
  23. Morris, N.J., Kutulakos, K.N.: Reconstructing the surface of inhomogeneous transparent scenes by scatter-trace photography. In: ICCV, pp. 1鈥?. IEEE (2007)
  24. Murase, H.: Surface shape reconstruction of an undulating transparent object. In: ICCV, pp. 313鈥?17. IEEE (1990)
  25. Narasimhan, S.G., Nayar, S.K., Sun, B., Koppal, S.J.: Structured light in scattering media. In: ICCV, vol.聽1, pp. 420鈥?27. IEEE ( (2005)
  26. Oreifej, O., Shu, G., Pace, T., Shah, M.: A two-stage reconstruction approach for seeing through water. In: CVPR, pp. 1153鈥?160. IEEE (2011)
  27. Scharstein, D., Szeliski, R.: A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. IJCV聽47(1-3), 7鈥?2 (2002) CrossRef
  28. Schechner, Y.Y., Karpel, N.: Recovery of underwater visibility and structure by polarization analysis. IEEE Journal of Oceanic Engineering聽30(3), 570鈥?87 (2005) CrossRef
  29. Schechner, Y.Y., Kiryati, N.: Depth from defocus vs. stereo: How different really are they? IJCV聽39(2), 141鈥?62 (2000) CrossRef
  30. Tian, Y., Narasimhan, S.G.: Seeing through water: Image restoration using model-based tracking. In: ICCV, pp. 2303鈥?310. IEEE (2009)
  31. Tian, Y., Narasimhan, S.G.: A globally optimal data-driven approach for image distortion estimation. In: CVPR, pp. 1277鈥?284. IEEE (2010)
  32. Treibitz, T., Schechner, Y., Kunz, C., Singh, H.: Flat refractive geometry. PAMI聽34(1), 51鈥?5 (2012) CrossRef
  33. Wen, Z., Lambert, A., Fraser, D., Li, H.: Bispectral analysis and recovery of images distorted by a moving water surface. Applied Optics聽49(33), 6376鈥?384 (2010) CrossRef
  34. Wetzstein, G., Roodnick, D., Heidrich, W., Raskar, R.: Refractive shape from light field distortion. In: ICCV, pp. 1180鈥?186. IEEE (2011)
  35. Yau, T., Gong, M., Yang, Y.-H.: Underwater camera calibration using wavelength triangulation. In: CVPR, pp. 2499鈥?506. IEEE (2013)
  36. Ye, J., Ji, Y., Li, F., Yu, J.: Angular domain reconstruction of dynamic 3d fluid surfaces. In: CVPR, pp. 310鈥?17. IEEE (2012)
  
• 作者单位：Mingjie Zhang (19)
  Xing Lin (19)
  Mohit Gupta (20)
  Jinli Suo (19)
  Qionghai Dai (19)
  
  19. Department of Automation, Tsinghua University, China
  20. Columbia University, USA
  
• ISSN：1611-3349

文摘

In this paper, we consider scenes that are immersed in transparent refractive media with a dynamic surface. We take the first steps to reconstruct both the 3D fluid surface shape and the 3D structure of immersed scene simultaneously by utilizing distortion and defocus clues. We demonstrate that the images captured through a refractive dynamic fluid surface are the distorted and blurred versions of all-in-focused (AIF) images captured through a flat fluid surface. The amounts of distortion and refractive blur are formulated by the shape of fluid surface, scene depth and camera parameters, based on our refractive geometry model of a finite aperture imaging system. An iterative optimization algorithm is proposed to reconstruct the distortion and immersed scene depth, which are then used to infer the 3D fluid surface. We validate and demonstrate the effectiveness of our approach on a variety of synthetic and real scenes under different fluid surfaces.