基于深度图像的建模绘制技术研究
|
摘要
基于图像的绘制技术目前已在图形学领域引起了极大的关注，它在图像合成方面的强大优势给传统基于几何绘制技术带来了另一种选择。基于深度图像的几何模型绘制从另一个角度弥补了传统基于几何绘制技术的不足，它绘制速度更快、与模型复杂度无关而且对资源要求更少，因而对于大数据量几何模型的简化和实时三维仿真具有重要的研究价值。
本文深入研究了基于深度图像的几何模型建模绘制技术，着重分析研究了这一技术领域的3D Warp算法，在深入理解其算法原理的基础上对这一重要算法进行了理想的数学分解，使图像的3D Warp变换在实现中可分为预Warp和纹理映射两步完成，充分发挥了纹理映射硬件的优势，极大地加快了图像Warp变换的速度。分解后，图像预Warp变换等式具有非常简单的一维结构，可以沿图像的行、列独立地一维操作实现，每次只须在两个相邻的像素之间线性插值处理空洞填充。最后本文构建了一个软件系统，能够采样几何模型6个面的深度图像，按包围盒方式对整个模型重新进行基于图像的建模绘制，在微机上实现了大数据量几何模型的快速实时显示。
本文在理论上详细推导了3D Warp等式的数学分解；实践上系统论证了图像一维Warp变换的正确性和健壮性；实现了采样几何模型6个面的深度图像后按包围盒方式重新绘制模型的具体过程。
Image-based rendering techniques have gained considerable attention in the graphics community because of their potential advantage in image synthesizing which can bring another alternative for traditional geometry-based rendering techniques. Depth image-based rendering for geometry models gives another compensation for traditional geometry-based rendering techniques with its faster rendering,independent of geometry complexity and needing less computing resource,So it is very valuable for simplifying very large data geometry models and displaying them in real time.
This dissertation deeply investigates depth image-based modeling and rendering techniques,further on 3D image-warping,presents a division of 3D image-warping in mathematics with fully understanding it,Then 3D image-warping can he implemented by pre-warp and texture mapping. This can efficiently take advantage of the texture mapping hardware. So the warping operation is much faster. After factoring the 3D image-warping equation,the pre-warping equation has a very simple structure. It can be divided into two-pass process using 1-D operations along rows and columns and only interpolating between two adjacent pixels each time. At last,an image-based modeling and rendering system is cast,which can display a geometry model with images after sampling six depth images around a model's bounding box,displaying geometry models in real-time is realized under ordinary computer.
This dissertation presents a concrete deduce for factoring the 3d image-warping equation;confirmed the correctness and robustness of ID warp and reconstruction;realizes the whole modeling procedure after sampling six depth images around the model's bounding box.
本文深入研究了基于深度图像的几何模型建模绘制技术，着重分析研究了这一技术领域的3D Warp算法，在深入理解其算法原理的基础上对这一重要算法进行了理想的数学分解，使图像的3D Warp变换在实现中可分为预Warp和纹理映射两步完成，充分发挥了纹理映射硬件的优势，极大地加快了图像Warp变换的速度。分解后，图像预Warp变换等式具有非常简单的一维结构，可以沿图像的行、列独立地一维操作实现，每次只须在两个相邻的像素之间线性插值处理空洞填充。最后本文构建了一个软件系统，能够采样几何模型6个面的深度图像，按包围盒方式对整个模型重新进行基于图像的建模绘制，在微机上实现了大数据量几何模型的快速实时显示。
本文在理论上详细推导了3D Warp等式的数学分解；实践上系统论证了图像一维Warp变换的正确性和健壮性；实现了采样几何模型6个面的深度图像后按包围盒方式重新绘制模型的具体过程。
Image-based rendering techniques have gained considerable attention in the graphics community because of their potential advantage in image synthesizing which can bring another alternative for traditional geometry-based rendering techniques. Depth image-based rendering for geometry models gives another compensation for traditional geometry-based rendering techniques with its faster rendering,independent of geometry complexity and needing less computing resource,So it is very valuable for simplifying very large data geometry models and displaying them in real time.
This dissertation deeply investigates depth image-based modeling and rendering techniques,further on 3D image-warping,presents a division of 3D image-warping in mathematics with fully understanding it,Then 3D image-warping can he implemented by pre-warp and texture mapping. This can efficiently take advantage of the texture mapping hardware. So the warping operation is much faster. After factoring the 3D image-warping equation,the pre-warping equation has a very simple structure. It can be divided into two-pass process using 1-D operations along rows and columns and only interpolating between two adjacent pixels each time. At last,an image-based modeling and rendering system is cast,which can display a geometry model with images after sampling six depth images around a model's bounding box,displaying geometry models in real-time is realized under ordinary computer.
This dissertation presents a concrete deduce for factoring the 3d image-warping equation;confirmed the correctness and robustness of ID warp and reconstruction;realizes the whole modeling procedure after sampling six depth images around the model's bounding box.
引文
[1] McMillan, L. An Image-Based Approach to Three-Dimensional Computer Graphics. Ph.D. Dissertation. UNC Computer Science Technical Report TR97-013, University of North Carolina, April 1997.
[2] Leonard McMillan and Gary Bishop. Plenoptic modeling: An image-based rendering system. In Computer Graphics Annual Conference Series (Proceedings of Siggraph 95), pages 39-46, Los Angeles, CA, August 1995.
[3] Szeliski R. Video mosaics for virtual environment. IEEE Computer Graphics and Applications, pp. 22-30, March 1996.
[4] Kang S. B. and Weiss R. Characterization of errors in compositing panoramic images. Technical Report 96/2, Digital Equipment Corporation, Cambridge Research Lab, June 1996.
[5] Kang S. B. and Desikan P. K. Virtual Navigation of Complex Scenes using Clusters of Cylindrical Panoramic images. Technical Report 97/5, Digital Equipment Corporation, Cambridge Research Lab, June 1997.
[6] Shum H. Y. and Szeliski R. Panoramic Image Mosaics. Technical Report MSR-TR-97-23, Microsoft Research, 1997.
[7] Shum Heung-Yeung and He Li-Wei. Rendering with Concentric Mosaics. Computer Graphics (Siggraph'99), pp.299-306, 1999.
[8] Xiong Y. and Turkowski. Creating image-based VR using a self-calibrating fisheye lens. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'97), pp. 237-243, San Juan, Puerto Rico, June 1997.
[9] Chen S. E. QuickTime VR: an image-based approach to virtual environment navigation. Computer Graphics (Siggraph'95), pp. 279-288, Aug. 1995.
[10] Apple Corp. An Introduce to QuickTime. Apple Corp. 2000, At: http://developer.apple.com/quick-time/qttutorial/.
[11] Apple Corp. The Architecture of QuickTime 5.0. Apple Corp. 2000. http://developer.apple.com/quicktime/qttutoriai/overview.html#Arch.
[12] Kuglin C. D. and Hines D.C. The phase correlation image alignment method. in IEEE 1975 Conference on Cybernetics and Society, New York, Sep. 1975, pp. 163-165.
[13] Zoghlami I., Faugeras O. and Deriche R. Using geometric coners to build a 2D mosaic from a set of images. in Conference on Computer Vision and Pattern Recognition, San Juan, Puerto Rico, Junce 1997 pp. 420-425.
[14] Wolberg, George. Recent Advances in Image Morphing. Computer Graphics International '96, p5-7, 1996.
[15] Lee, S.Y, K. Y. Chwa, James Hahn, S. Y. Shin. Image morphing using deformation techniques. J. Visualization Computer. Animation 7 (1996), p2-3.
[16] Tang, Wei-Pai, CS 370 - Introduction to Scientific Computing - Lecture Slides, Winter 1999.
[17] Roger Claypoole, Jim Lewis, Srikrishna Bhashyam, and Kevin Kelly. ELEC 539: Image Morphing.(7th April 12, 2001).
[18] Seitz S. M. and Dyer C.R. View Morphing. Siggraph'96, 1996. pp.21-30.
[19] Seitz S.M. Image-Based transformation of viewpoint and scene apprearence. PH. D thesis, University of Wisconsin-Madison, 1997.
[20] Seitz S. M. and Dyer C. R., View morphing: Uniquely predicting scene appearance from basis images, Proc. Image Understanding Workshop, 1997, 881-887.
[21] Seitz S. M., Bringing photographs to life with view morphing, Proc. Imagina 97, 1997, 153-158.
[22] Paul E. Debevec Modeling and Rendering Architecture from Photographs. PhD the-sis, University of California at Berkeley, Computer Science Division, Berkeley CA, 1996.http://www.debevec.org/Thesis.
[23] Manuel M. Oliveira, Gary Bishop, Relief Textures, Technical Report TR99-015, March 29, 1999 Department of Computer Science, University of North Carolina at Chapel Hill; Manuel M. Oliveira, Gary Bishop, Factoring 3-D Image Warping Equations into a Pre-Warp Followed by Conventional Texture Mapping, UNC Computer Science Technical Report TR99-002, University of North Carolina, January 1999
[24] Peter Lindstrom Model Simplification using Image and Geometry- Based Metrics, PhD. Thesis, In Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy in Computer Science Georgia Institute of Technology November 28, 2000.
[25] Gomes, J., Velho, L. Image Processing for Computer Graphics. Springer-Verlag, 1997.
[26] Irani, M., Rousso, B., Peleg, S. "Recovery of Ego-Motion Using Region Alignment". IEEE Transactions on Pattern Analysis and Machine Intelligence, Volume 19, No. 3, pp. 268-272, March 1997.
[27] Sawhney, H. "3D Geometry from Planar Parallax". In IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '94), pages 929-934. IEEE Computer Society, Seattle, Washington, June 1994.
[28] Kumar, R., Anandan, P., Hanna, K. "Direct Recovery of Shape from Multiple Views: A Parallax Based Approach". In Twelfth Internafional Conference on Pattern Recognilion (ICPR '94), Volume A, pp. 685-688. IEEE Computer Society Press, Jerusalem, Israel, October 1994.
[29] Irani, M., Anandan, P. "Parallax Geometry of Pairs of Points for 3D Scene Analysis". European Conference on Computer Vision, pp. Ⅰ:17-30, Cambridge, England, April 1996.
[30] Irani, M., Anandan, P. "Parallax Geometry of Pairs of Points for 3D ScencAnalysis". European Conference on Computer Vision, pp. Ⅰ: 17-30, Cambridge, England, April 1996.
[31] Westover, L. "Footprint Evaluation for Volume Rendering". Proc. SIGGRAPH 90. In Computer Graphics Proceedings. Annual Conference Series, 1990, ACM SIGGRAPH, pp. 367-376.
[32] Shade, J., et al. "Layercd Depth Images". Proc. SIGGRAPH 98 (Orlando, FL, July 19-24, 1998). In Computer Graphicx Proceedings. Annual Conference Series, 1998, ACM SIGGRAPH, pp. 231-242.
[33] Catmull, E., Smith, A. "3D Transformations of Images in Scanline Order". Proc. SIGGRAPH 80 (Seattle, Washington, July 14-18, 1980). InComputer Graphics Proceedings. Annual Conference Series, 1980, ACMSIGGRAPH, pp. 279-285.
[34] Smith, Alvy Ray. "Planar 2-Pass Texture Mapping and Warping". Proc. SIGGRAPH87 (Anaheim, CA, July 27-31, 1987). In Computer Graphics Proceedings. Annual Conference Series, 1987, ACM SIGGRAPH, pp. 263-272.
[35] Fant, Karl. "A Nonaliasing, Real-Time Spatial Transform Technique". IEEE Computer Graphics and Application, Vol. 6, No 1, January 1986, pp. 71-80.
[36] Wolberg, G.. Digital Image Warping. IEEE Computer Society Press, 1990.
[37] Gortler, S., et al.. "The Lumigraph". Proc. SIGGRAPH 96 (New Orleans, LA, August 4-9, 1996). In Computer Graphics Proceedings. Annual Conference Series, 1996, ACM SIGGRAPH, pp. 43-54.
[38] Levoy, M., Hanrahan, P. "Light Field Rendering". Proc. SIGGRAPH 96 (New Orleans, LA, August 4-9, 1996). In Computer Graphics Proceedings. Annual Conference Series, 1996, ACM SIGGRAPH, pp. 31-42.
[39] Grossman, J., Dally, W. "Point Sample Rendering". Proceedings of the 9_(th) Eurographics Workshop on Rendering. Vienna, Austria, June 1998. Rendering Techniques '98, Springer-Verlag, pp. 181-192.
[40] Schaufler, G. "Per-Object Image Warping with Layered Impostors". Proceedings of the 9_(th) Eurographics Workshop on Rendering. Vienna, Austria, June 1998. Rendering Techniques '98, Springer-Verlag, pp. 145-156.
[41] Erikson, K., Manocha, D. "GAPS: General and Automatic Polygonal Simplification". Proceedings of 1999 ACM Symposium on Interactive 3D Graphics. Atlanta, Ga, April 26-28, 1999, pp. 79-88.
[42] Woo, M., et al. OpenGL Programming Guide. 2_(nd) edition. Addison Wesley, 1997.
[2] Leonard McMillan and Gary Bishop. Plenoptic modeling: An image-based rendering system. In Computer Graphics Annual Conference Series (Proceedings of Siggraph 95), pages 39-46, Los Angeles, CA, August 1995.
[3] Szeliski R. Video mosaics for virtual environment. IEEE Computer Graphics and Applications, pp. 22-30, March 1996.
[4] Kang S. B. and Weiss R. Characterization of errors in compositing panoramic images. Technical Report 96/2, Digital Equipment Corporation, Cambridge Research Lab, June 1996.
[5] Kang S. B. and Desikan P. K. Virtual Navigation of Complex Scenes using Clusters of Cylindrical Panoramic images. Technical Report 97/5, Digital Equipment Corporation, Cambridge Research Lab, June 1997.
[6] Shum H. Y. and Szeliski R. Panoramic Image Mosaics. Technical Report MSR-TR-97-23, Microsoft Research, 1997.
[7] Shum Heung-Yeung and He Li-Wei. Rendering with Concentric Mosaics. Computer Graphics (Siggraph'99), pp.299-306, 1999.
[8] Xiong Y. and Turkowski. Creating image-based VR using a self-calibrating fisheye lens. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'97), pp. 237-243, San Juan, Puerto Rico, June 1997.
[9] Chen S. E. QuickTime VR: an image-based approach to virtual environment navigation. Computer Graphics (Siggraph'95), pp. 279-288, Aug. 1995.
[10] Apple Corp. An Introduce to QuickTime. Apple Corp. 2000, At: http://developer.apple.com/quick-time/qttutorial/.
[11] Apple Corp. The Architecture of QuickTime 5.0. Apple Corp. 2000. http://developer.apple.com/quicktime/qttutoriai/overview.html#Arch.
[12] Kuglin C. D. and Hines D.C. The phase correlation image alignment method. in IEEE 1975 Conference on Cybernetics and Society, New York, Sep. 1975, pp. 163-165.
[13] Zoghlami I., Faugeras O. and Deriche R. Using geometric coners to build a 2D mosaic from a set of images. in Conference on Computer Vision and Pattern Recognition, San Juan, Puerto Rico, Junce 1997 pp. 420-425.
[14] Wolberg, George. Recent Advances in Image Morphing. Computer Graphics International '96, p5-7, 1996.
[15] Lee, S.Y, K. Y. Chwa, James Hahn, S. Y. Shin. Image morphing using deformation techniques. J. Visualization Computer. Animation 7 (1996), p2-3.
[16] Tang, Wei-Pai, CS 370 - Introduction to Scientific Computing - Lecture Slides, Winter 1999.
[17] Roger Claypoole, Jim Lewis, Srikrishna Bhashyam, and Kevin Kelly. ELEC 539: Image Morphing.(7th April 12, 2001).
[18] Seitz S. M. and Dyer C.R. View Morphing. Siggraph'96, 1996. pp.21-30.
[19] Seitz S.M. Image-Based transformation of viewpoint and scene apprearence. PH. D thesis, University of Wisconsin-Madison, 1997.
[20] Seitz S. M. and Dyer C. R., View morphing: Uniquely predicting scene appearance from basis images, Proc. Image Understanding Workshop, 1997, 881-887.
[21] Seitz S. M., Bringing photographs to life with view morphing, Proc. Imagina 97, 1997, 153-158.
[22] Paul E. Debevec Modeling and Rendering Architecture from Photographs. PhD the-sis, University of California at Berkeley, Computer Science Division, Berkeley CA, 1996.http://www.debevec.org/Thesis.
[23] Manuel M. Oliveira, Gary Bishop, Relief Textures, Technical Report TR99-015, March 29, 1999 Department of Computer Science, University of North Carolina at Chapel Hill; Manuel M. Oliveira, Gary Bishop, Factoring 3-D Image Warping Equations into a Pre-Warp Followed by Conventional Texture Mapping, UNC Computer Science Technical Report TR99-002, University of North Carolina, January 1999
[24] Peter Lindstrom Model Simplification using Image and Geometry- Based Metrics, PhD. Thesis, In Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy in Computer Science Georgia Institute of Technology November 28, 2000.
[25] Gomes, J., Velho, L. Image Processing for Computer Graphics. Springer-Verlag, 1997.
[26] Irani, M., Rousso, B., Peleg, S. "Recovery of Ego-Motion Using Region Alignment". IEEE Transactions on Pattern Analysis and Machine Intelligence, Volume 19, No. 3, pp. 268-272, March 1997.
[27] Sawhney, H. "3D Geometry from Planar Parallax". In IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '94), pages 929-934. IEEE Computer Society, Seattle, Washington, June 1994.
[28] Kumar, R., Anandan, P., Hanna, K. "Direct Recovery of Shape from Multiple Views: A Parallax Based Approach". In Twelfth Internafional Conference on Pattern Recognilion (ICPR '94), Volume A, pp. 685-688. IEEE Computer Society Press, Jerusalem, Israel, October 1994.
[29] Irani, M., Anandan, P. "Parallax Geometry of Pairs of Points for 3D Scene Analysis". European Conference on Computer Vision, pp. Ⅰ:17-30, Cambridge, England, April 1996.
[30] Irani, M., Anandan, P. "Parallax Geometry of Pairs of Points for 3D ScencAnalysis". European Conference on Computer Vision, pp. Ⅰ: 17-30, Cambridge, England, April 1996.
[31] Westover, L. "Footprint Evaluation for Volume Rendering". Proc. SIGGRAPH 90. In Computer Graphics Proceedings. Annual Conference Series, 1990, ACM SIGGRAPH, pp. 367-376.
[32] Shade, J., et al. "Layercd Depth Images". Proc. SIGGRAPH 98 (Orlando, FL, July 19-24, 1998). In Computer Graphicx Proceedings. Annual Conference Series, 1998, ACM SIGGRAPH, pp. 231-242.
[33] Catmull, E., Smith, A. "3D Transformations of Images in Scanline Order". Proc. SIGGRAPH 80 (Seattle, Washington, July 14-18, 1980). InComputer Graphics Proceedings. Annual Conference Series, 1980, ACMSIGGRAPH, pp. 279-285.
[34] Smith, Alvy Ray. "Planar 2-Pass Texture Mapping and Warping". Proc. SIGGRAPH87 (Anaheim, CA, July 27-31, 1987). In Computer Graphics Proceedings. Annual Conference Series, 1987, ACM SIGGRAPH, pp. 263-272.
[35] Fant, Karl. "A Nonaliasing, Real-Time Spatial Transform Technique". IEEE Computer Graphics and Application, Vol. 6, No 1, January 1986, pp. 71-80.
[36] Wolberg, G.. Digital Image Warping. IEEE Computer Society Press, 1990.
[37] Gortler, S., et al.. "The Lumigraph". Proc. SIGGRAPH 96 (New Orleans, LA, August 4-9, 1996). In Computer Graphics Proceedings. Annual Conference Series, 1996, ACM SIGGRAPH, pp. 43-54.
[38] Levoy, M., Hanrahan, P. "Light Field Rendering". Proc. SIGGRAPH 96 (New Orleans, LA, August 4-9, 1996). In Computer Graphics Proceedings. Annual Conference Series, 1996, ACM SIGGRAPH, pp. 31-42.
[39] Grossman, J., Dally, W. "Point Sample Rendering". Proceedings of the 9_(th) Eurographics Workshop on Rendering. Vienna, Austria, June 1998. Rendering Techniques '98, Springer-Verlag, pp. 181-192.
[40] Schaufler, G. "Per-Object Image Warping with Layered Impostors". Proceedings of the 9_(th) Eurographics Workshop on Rendering. Vienna, Austria, June 1998. Rendering Techniques '98, Springer-Verlag, pp. 145-156.
[41] Erikson, K., Manocha, D. "GAPS: General and Automatic Polygonal Simplification". Proceedings of 1999 ACM Symposium on Interactive 3D Graphics. Atlanta, Ga, April 26-28, 1999, pp. 79-88.
[42] Woo, M., et al. OpenGL Programming Guide. 2_(nd) edition. Addison Wesley, 1997.