三维动态显示技术研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
随着多媒体技术的不断发展,简单的平面二维显示已经不能满足人们的需求,人们希望能够更直接地反映现实世界,而二维图像只能使人们了解到世界的某个空间侧面信息,从而限制了人们对世界的全面认识,因此三维动态显示将成为未来显示领域的研究热点。
     近几年来,由于计算机性能和处理能力的大幅提高,三维动态显示技术已取得了突破性的发展。三维动态显示是经典的二维平面视频的扩展,相比于二维视频,三维动态显示可以给用户提供全方位沉浸式的感受。三维动态显示技术可以广泛应用于数字电视、远程教育、远程工业控制、三维视频会议系统、虚拟现实系统等诸多方面。
     真三维显示是一种无需借助其它器具就能够实现360度视角观察、观看显示出的三维物体与观看真实物体完全一样的三维显示技术。显示出的视景具有真实三维性,能提供几乎所有的视觉深度暗示,视点不受限制,完全符合人类对真实三维物理世界的观看方式。本文首先对真三维显示系统进行分析,在此基础之上,对三维动态显示技术中三个关键技术进行了深入研究。
     首先,对面向真三维系统的人机交互技术进行了研究,提出了适用于真三维静态显示的三维光笔交互系统,并用理论证明了该方法的可行性。其次,对三维视频压缩技术进行了研究,结合目前三维视频压缩技术发展方向及真三维系统的特点,提出了一种基于全景采集的时空同步三维视频编码,通过实验对时间和空间压缩不同顺序的三种压缩模式进行了比较,从而得出结论。最后,为了保证真三维系统中多路视频输入输出的同步性,对多路视频帧同步软件进行了设计,并与帧同步硬件设备联合测试,验证了该软件的帧同步性能。
With the continuous development of multimedia technology, simply two-dimensional display already cannot satisfy people's needs, people want to know the real world more directly. But two-dimensional image can only show people some sides of the world, which make people can’t know the whole world comprehensively. Therefore three-dimensional dynamic display will become a hotspot in the field of display in the future.
     In recent years, due to great improvement of computer’s performance and processing capacity, three-dimensional dynamic display has made great breakthrough. Three-dimensional dynamic display is a expansion of the classical two-dimensional display, it can provide users a omni-directional tele-immersive feeling compared to two-dimensional display. Nowadays, three-dimensional dynamic display can be widely used in digital television, remote education, remote industrial control, 3d video conference system, virtual reality system, and other aspects.
     True three-dimensional display can show users the world itself and provide users with 360 degree angle of view without any other instruments. It can also provide most of the visual depth hint、unrestricted viewpoint, and accord to the way in which people observing the real three-dimensional world. Firstly in this paper, the system of true three-dimensional display was analyzed. Based on the analyses, three key technologies of three-dimensional dynamic display were studied.
     First of all, the human-computer interaction techniques facing to true three-dimensional system were studied. Then a three-dimensional light-pen interactive system applicable to real three-dimensional static display was put forward, and the feasibility of this method was proved by theory. Secondly, three-dimensional video compression technology was studied. After that, a space-time synchronous three-dimensional video coding based on panoramic view collection was presented. Then the three compression models based on different time-space orders were compared by experiment, thus the conclusion was drew. Finally, in order to guarantee the synchronicity of multiple video input and output in true three-dimensional system, the multiple video frame synchronization software was designed. And the performance of it was verified by test with frame synchronization hardware device.
引文
[1]秦文虎,狄岚,姚晓峰,陈伟琦.虚拟现实基础及可视化设计[M].北京:化学工业出版社, 2009:14-15
    [2] D. Miyazaki, K. shiba, K. Sotsuka, and K. Matsushita. Volumetric display system based on three-dimensional scanning of inclined optical image[J]. Opt. Express, 2006:14-17
    [3] M. Kawakita, H. Sasaki, J. Arai, F. Okano, K. Suehiro, Y. Haino, M. Yoshimura and M. Sato. Geometric analysis of spatial distortion in projection-type integral imaging[J]. Opt. Lett, 2008:33-37
    [4] F. Okano, J. Arai, and M. kawakita. Wave optical analysis of integral method for three-dimensional images[J]. Opt. Lett, 2007:32-34
    [5] M. Cho and B. Javidi. Three-dimensional tracking of occluded objects using integral imaging[J]. Opt. Lett. 2008:33-36
    [6] J.-H Park, H.-R. Kim, Y. Kim, J. Kim, J. Hong, S.-D. Lee and B. Lee. Depth-enhanced three-dimensional-two-dimensional convertible display based on modified integral imaging[J]. Opt. Lett. 2004:29-32
    [7] Y.-W. Song, and B. Javidi. 3D object scaling in integral imaging display by varying the spatial ray sampling rate[J]. Opt. Express, 2005:13-17
    [8] F.C. Fan, and S. Choi. Equipment and method to make digital speckle hologram[P]. Chinese Patent, ZL200410022193.7.
    [9] D. Abookasis, and J. Rosen. Computer-generated holograms of three-dimensional objects synthesized from their multiple angular viewpoints[J]. J. Opt. Soc. Am. A , 2003:20-25
    [10] J.-Y Son, B. Javidi and K.D. Kwack,“Methods for displaying three-dimensional images,”Proc. IEEE., June2006
    [11] H. Kang, T. Fujii, T. Yamaguchi, and H. Yoshikawa. Compensated phase-added stereogram for real-time holographic display[J]. Opt. Eng,2007:46
    [12] J.-H. Park, Y. Kim, J. Kim, S.-W Min and B. Lee. Three-dimensional display scheme based integral imaging with three-dimensional information processing[J]. Opt.Express,2004:12-16
    [13] H. Kim, J. Hahn and B. Lee. Image volume analysis of omnidirectional parallax regular-polyhedron three-dimensional displays[J]. Opt. Express, 2009:17-19
    [14] E. Downing, L. Hesselink, J. Ralston, R.A. Macfarlane. Three-color, solid-state three-dimensional display[J]. Science, 1996:273-280
    [15]朱庆.三维动态交互式可视化模型.武汉测绘科技大学学报[J], 1998:124-127
    [16]张晓洁,林远芳,刘旭,刘向东.基于时序效应的空间三维显示系统[J].仪器仪表学报, 2003:217-219
    [17]姜盈,王惠南.真三维立体显示系统中平移体扫描技术研究[J].计算机应用, 2006:135-137
    [18]王辉,彭保进,徐冬云.高质量三维物体真彩色全息图的制作[J].光学仪器,1995:31-35
    [19] S. Tay, P.-A. Blanche, R. Voorakaranam, A. V. Tunc, W. Lin, S. Rokutanda, T. Gu, D. Flores, P. Wang, G. Li, P.St. Hilaire, J. Thomas, R. A. Norwood, M. Yamamoto, and N. Peyghambarian. An updatable holographic three-dimensional display[J]. Nature, 2008:694-699
    [20] N.T. Shaked, J. Rosen and A. Stern. Integral holography: white-light single-shot hologram acquisition[J]. Opt. Express, 2007:15-19
    [21]季家镕.高等光学教程[M].北京:科学出版社, 2007:55-57
    [22] Frank C.Fan, Sam Choi, C.C.Jiang. Use of spatial spectrum of light to recover threedimensional holographic nature[J]. Optics Infobase, 2010:2676-2685
    [23]石教英.虚拟现实基础及实用算法[M].北京:科学出版社, 2002:13-14
    [24]韦有双,杨湘龙,王飞.虚拟现实与系统仿真[M].北京:国防工业出版社, 2004:6-7
    [25]徐周. GPS差分定位技术及实现方法的研究[D].河南:解放军信息工程大学, 2006:4-10
    [26]袁翠.差分GPS算法及仿真研究[D].大连:大连海事大学, 2007:9-19
    [27]彭凯.光笔三坐标视觉测量系统关键技术的研究[D].天津:天津大学精密仪器与光电子工程学院, 2004:26-30
    [28]周富强,邾继贵,杨学友,叶声华. CCD摄像机快速标定技术[J].光学精密工程, 2000,8(1):96-100
    [29]辛悦向.光笔式双目立体视觉系统的研究[D].山东:中国海洋大学.硕士学位论文, 2008:12-14
    [30] Sang Xinzhu, F.C. Fan, Dou Wenhua, et al. Demonstration of a large-size real-time full-color three-dimensional display[J]. Optics Letters, 2009, 34(24):3803-3805.
    [31]毕厚杰,王健.新一代视频压缩编码标准——H.264/AVC[M].北京:人民邮电出版社, 2009:11-14.
    [32]张晓芸,宋建社,郑永安.视频编码技术研究进展[J].计算机工程, 2004,30(14):4-6
    [33]张宗平,刘贵忠.基于小波变换的视频压缩进展[J].电子学报,2002,30(6):883-889.
    [34]罗一平.真正三维小波变换及在视频图像编码中的应用[J].光电工程,2002,29(2):55-58.
    [35]朱波,彭宗举,张云.面向三维视频系统的深度图压缩方法研究[J].宁波大学学报, 2009,22(3):317-321
    [36] SMOLIC A, MUELLER K, MERKLE P, et al. Multi-view video plus depth (MVD)[C]. format for advanced 3D video systems USA: San Jose,2007
    [37] KRISHNAMURTHY R, TAO H. Compression and transmission of depth maps for image-based rendering[C]. Thessaloniki:Image Processing Proceedings, 2001
    [38] MORVAN Y, FARIN D. Depth-image compression based on an R-D optimized quad tree decomposition for the transmission of multiview images[J]. IEEE Int, 2007:105-108.
    [39] HO Y S, LEE C. Depth map generation and virtual view synthesis[C]. China: Shenzhen, 2007.
    [40] Yannick Morvan, Dirk Farin, and Peter H. N. de With. Multiview Depth-Image Compression Using an Extended H.264 Encode[C]. Proceedings of the 9th international conference on Advanced concepts for intelligent vision systems,2007:675-686
    [41] Yannick Morvan, Dirk Farin and Peter H. N. de With.Predictive Coding of Depth Images Across Multiple View. Stereoscopic displays and virtual reality systems[C], California, USA, 2007:29-31
    [42] Yannick Morvan, Dirk Farin and Peter H. N. de With. Incorporating depth-image based view-prediction into H.264 for multiview-image coding[J]. IEEE, 2007:205-208
    [43]邵政,曾理,PATRICK R.HUNZIKER.高维图像压缩的小波方法[J].微机发展,2005,15,2:6-9.
    [44] ZHENYU YANG, YI CUI, ZAHID ANWAR , et al. Real-Time 3D Video Compression for Tele-Immersive Environments[C]. Proceedings of Multimedia Computing and Networking,2006.
    [45] A. Vetro, S. Yea, M. Zwicker, W. Matusik, H. Pfister. Overview of Multiview Video Coding and Anti-Aliasing for 3D Displays[J]. IEEE International Conference on Image Processing (ICIP), 2007:I-17 - I-20
    [46] P. Merkle, K. Muller, A. Smolic, and T. Wiegand. Efficient compression of cultiview video exploiting inter-view dependencies based on H.264/AVC[C]. In Proc. IEEE int’l conf. Multimedia&Expo, 2006
    [47] E. Martinian, A. Behrens, J. Xin, A. Vetro, and H. Sun.Extensions of H.264/AVC for multiview video compression[C]. In Proc. IEEE Int’l Conf. Image Proc,2006
    [48] K. Müller and et. al. Multi-view Video Coding Based on H.264/AVC Using Hierarchical B-Frames[C]. PCS 2006, China, 2006
    [49] E. Martinian and et. al. View Synthesis for Multi-view Video Compression[C].Proc. PCS 2006, Beijing, China, April,2006.
    [50] Goran Petrovic, Luat Do, Sveta Zinger, and Peter H. N. de With. Virtual View Adaptation for 3D Multi-View Video Streaming[C]. Proceedings of the SPIE, 2010:752410-1-752410-12
    [51] E. Ekmekcioglu, S.T. Worrall, A.M. Kondoz. MULTI-VIEW VIDEO CODING VIA VIRTUAL VIEW GENERATION[C]. Picture Coding Symposium, Lisbon, Portugal, 2007
    [52] M. Kitahara and et. al. Multi-view Video Coding using View Interpolation and Reference Picture Selection[C]. IEEE International Conference on Multimedia and Exposition, Toronto, Ontario, Canada, 2006.
    [53] Y.L. Lee et al. Illumination compression[C]. in Doc. JVT-U052, Hangzhou, China, 2006
    [54] Jae-Ho Hur, Sukhee Cho, and Yung-Lyul Lee. Adaptive Local Illumination Change Compensation Method for H.264/AVC-Based Multiview Video Coding[C]. IEEE Transactions on circuits and systems for video technology, 2007,17(11):1496-1505
    [55] E. Martinian, A. Behrens, J. Xin, and A. Vetro. View synthesis for multiview video compression[C]. In Proc. Picture Coding Symposium, 2006
    [56] M. Kitahara et al. Multiview video coding using view interpolation and reference picture selection[C]. In Proc. IEEE Int’l Conf. Multimedia & Expo, 2006:97-100
    [57]张新立.基于五维矩阵的多视角彩色视频流编码[D].吉林:吉林大学, 2007
    [58]马宣,马海武,周杰.基于三维小波变换的视频图像编码算法[J].计算机技术与发展, 2006,16(10):89-91
    [59] Sriram Sethuraman, Angel G.Jordan, M.W.Siegel. Multiresolution based hierarchical disparity estimation for stereo image pair compression[C]. Proc. of the Symposium on Application of subbands and wavelets, 1994,3
    [60]杨虹.基于H.264标准的立体视频压缩编码研究[D].吉林:吉林大学.硕士学位论文, 2007
    [61]杨名.基于摄像机阵列的三维实时视频获取系统硬件设计[D].浙江:浙江大学.硕士学位论文, 2010
    [62] Bennett Wilburm et al. High Performance Imaging Using Large Camera Arrays[J]. Proceedings of ACM AIGGRAPH, vol.24, Issue 3, pp.765-776, jul.2005
    [63] Michael Waschbüsch, 3D Video Acquisition, Representattion&Editing[C]. Ph.D.dissertation, ETH Zurich, Zurich, Switzerland, 2007
    [64] Akira Kubota. Multiview Imaging and 3DTV[J]. IEEE SIGNAL PROCESSING MAGAZINE, pp.10-21, Nov.2007
    [65] Cha Zhang, Tsuhan Chen. A Self-Reconfigurable Camera Array[C]. Proceedings of the Eurographics Symposium on Rendering, pp.243-254,2004
    [66]张茂军,李乐,包卫东,谭树人.面向3DTV的高分辨率摄像机阵列设计与实现[J]. 计算机应,用2008,7(28) : :1872-1874

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700