基于增强现实的虚拟会议系统研究
|
摘要
当前,网络视频会议系统的技术已经十分成熟,并广泛应用到社会生活的各个领域中。但是,传统的网络视频会议系统在很多针对性很强、需要很高的三维感观效果、且能够对研究模型能够进行灵活操作与调整的应用中缺陷显而易见。另外,增强现实技术也迅速发展起来,并取得了很多的应用成果,广泛应用到科学研究、教学、娱乐等社会生活中,很好地改善了科学研究条件,丰富了人们的日常文化生活等方面。
本文针对传统网络视频会议系统中存在的缺乏真实性和立体感的问题,提出了设计基于增强现实的网络视频会议系统的思想。
本文首先对基于增强现实的虚拟会议系统的整体框架做了概述,然后,对增强现实技术的图像分割与处理、三维注册算法、虚拟模型的输出和渲染等相关环节的原理做了阐析,并给出了其相关的推理过程,提出了对三维注册算法的改进。接着对网络视频会议系统的协议簇结构做了详细的解析,深入分析了MCU的控制策略,并根据本系统的具体特性做了抉择,提出了相关的改进措施。最后,以简化的H.323标准的协议簇和集中式MCU策略以及基于视觉的三维注册算法为基础,设计了一个基于增强现实的网络视频会议系统,并给出了相关测试结果。该系统将增强现实技术和网络技术结合起来,正好弥补了上述缺乏真实感、立体感和可操作性的缺点,提高了相关科研会议的质量和效率。
At present, the technology on Network Videoconferencing System (NVS) is becoming more and more full-blown and has applied to many fields in our lives. However, the defects of the traditional NVS are obvious in some special applications with the requirements of high quality 3D effects and flexible operability on research models. Besides, Augmented Reality Technology (ART) is also developing quickly and many results have been attained.
Targeting the shortage of reality and third-dimension effects in the traditional NVS, the thesis proposes an idea to design a NVS on the basis of ART.
The framework of NVS based on AR is briefed at the beginning of this thesis. Then the principle and mathematical reasoning process of ART’s each stage is discussed, including image partition and processing, 3D registration algorithm, virtual model output and rendering. The 3D algorithm is improved as a result. In the following part, the thesis explains the structure of NVS protocol suite in detail, analyzes the MCU strategy in depth and makes decisions as well as proposes related improvement methods according to the NVS’characteristics. At the end of the thesis, a system on the base of H.323 criterion’s MCU strategy and 3D registration algorithm based on vision is designed. The system combines ART with network technology and makes up for the defects and improves the validity of network videoconference.
本文针对传统网络视频会议系统中存在的缺乏真实性和立体感的问题,提出了设计基于增强现实的网络视频会议系统的思想。
本文首先对基于增强现实的虚拟会议系统的整体框架做了概述,然后,对增强现实技术的图像分割与处理、三维注册算法、虚拟模型的输出和渲染等相关环节的原理做了阐析,并给出了其相关的推理过程,提出了对三维注册算法的改进。接着对网络视频会议系统的协议簇结构做了详细的解析,深入分析了MCU的控制策略,并根据本系统的具体特性做了抉择,提出了相关的改进措施。最后,以简化的H.323标准的协议簇和集中式MCU策略以及基于视觉的三维注册算法为基础,设计了一个基于增强现实的网络视频会议系统,并给出了相关测试结果。该系统将增强现实技术和网络技术结合起来,正好弥补了上述缺乏真实感、立体感和可操作性的缺点,提高了相关科研会议的质量和效率。
At present, the technology on Network Videoconferencing System (NVS) is becoming more and more full-blown and has applied to many fields in our lives. However, the defects of the traditional NVS are obvious in some special applications with the requirements of high quality 3D effects and flexible operability on research models. Besides, Augmented Reality Technology (ART) is also developing quickly and many results have been attained.
Targeting the shortage of reality and third-dimension effects in the traditional NVS, the thesis proposes an idea to design a NVS on the basis of ART.
The framework of NVS based on AR is briefed at the beginning of this thesis. Then the principle and mathematical reasoning process of ART’s each stage is discussed, including image partition and processing, 3D registration algorithm, virtual model output and rendering. The 3D algorithm is improved as a result. In the following part, the thesis explains the structure of NVS protocol suite in detail, analyzes the MCU strategy in depth and makes decisions as well as proposes related improvement methods according to the NVS’characteristics. At the end of the thesis, a system on the base of H.323 criterion’s MCU strategy and 3D registration algorithm based on vision is designed. The system combines ART with network technology and makes up for the defects and improves the validity of network videoconference.
引文
[1]Tappert, Ruocco, Langdorf, Mabry, Heineman, TBrick, Cross, and SPellissier. Military Applications of Wearable Computers and Augmented Reality. U.S.Military Academy, WestPoint, 1997:625～647.
[2]Mark Billinghurst, Hirokazu Kato, Weghorst S., et a]. A Mixed Reality 3D Conferencing Application. Technical Report R-99-1,Human Interface Technology Laboratory, University of Washington, 1999: 5～8.
[3]Billinghurst, Weghorst, S., Furness. Shared Space: An Augmented Reality Approach for Computer Supported Cooperative Work. Virtual Reality. 1998 vol 3(1):25～36.
[4] Mark Billinghurst. A wearable spatial conferencing space. In: Proc. ISWC'98,Montrdal, Canada. IEEE Press, Pitsburgh, Penn,USA, October 1998:76～83.
[5]周雅,闰达远,王涌天等.一种增强现实系统的三维注册方法.中国图像图形学报,2000年5月,第5卷(A版),第5期:430～433.
[6] Ronald Azuma,Yohan Baillot, Reinhold Behringer, et al. Recent Advances in Augmented Reality. IEEE Computer Graphics and Applications. 2001 November/ December: 34-47.
[7]ITU-T Recommendation H.323 Draft V4.Packet-based multimedia Communications systems,2000.
[8]陆讽,郁梅.视频会议系统及应用.微机发展,,2001年第1期.
[9]蒋林涛.多媒体通信网[M].北京:人民邮电出版社,1999.
[10](日)田村秀行等.计算机图像处理技术,第1版.赫荣威等编译.北京:北京师 范大学出版社.1988年9月.
[11](日)谷口庆治.数字图像处理[基础篇],第1版.朱虹,廖学成,乐静译.北 京:科学出版社.2002年.
[12]王育峰,杨寿保,孙适.基于新一代网络协议的IP电话技术.计算机工程与应用,2002.12.
[13]曹宁,马银松,胡建荣.IP网络视频会议中MCU的实现及其控制策略.计算机工程.2000年第5期.
[14]姜海东,胡绍海,裘正定.H323中关守的功能及实现,数据通信,1999年第4期.
[15]郝又超,王文东.基于H.323网守的呼叫中心模型设计.现代电信科技,2000年第6期.
[16]ITU-T Recommendation H.245 Control protocol for multimedia communications, 1996.
[17]Uyless Black著,良友翻译组译.TCP/IP及相关协议[M].北京:机械工业出版社,1998.
[18]卢政加.如何成功的运用Openh323来开发商业的H.323协议栈,2002.11.
[19]黄丽亚.基于H.323的IP电话信令.电信快报,2001年第5期.
[20] Ronald Azuma. A survey of Augmented Reality. Teleoperator and Virtual Environments. 1997, 6:355～385.
[21] H.L.Pryor, T.A.Fumess, E.Viirre. The Virtual Retinal Display: A Nes Display Technology Using Scanned Laser Light. In:Proc. 42 nd Human Factors ErgonomicsSoc.,1998, Santa Monica, Calif: 1570-1574.
[22] R.Raskar, GWelch, W-C.Chen. Table-Top Spatially-Augmented Reality: Bringing Physical Models to Life with Projected Imagery. In:Proc.2nd Int'l Workshop Augmented Reality(IWAR 99), IEEE CS Press, Los Alamitos, 1999, Calif: 64～71.
[23] Hong Hua, Chunyu Gao, Brown, et al. Using a head-mounted projective display in interactive augmented. in:Augmented Reality, 2001 Proceedings. IEEE and ACM International Symposium 2001:217～223.
[24]陈靖,王涌天,施琦等.增强现实系统的动态注册.北京理工大学学报,2001, 第21卷,第5期:631～636.
[25] Chavel, P.&Strand, P.. Range measurement using Talbot difraction imaging of gratings. Applied Optics, 23(6), 1984:862～870.
[26] Raab F., Bood, E. Steiner, O &Jones, H.. Magnetic position and orientation tracking system. IEEE Transactions on Aerospace and Electronics Systems, AES-15(5), 1979: 709～717.
[27]Thomas Auer, Axel Pinz. The integration of optical and magnetic tracking for mult-user augmented reality. Computers&Graphics, 1999 vol.23:805～808.
[28]T.Auer and A Pinz. Building a Hybrid Tracking System: Integration of Optical and Magnetic Tracking. In: Proc.of IEEE International Workshop on Augmented Reality. 1999:13～22.
[29]周雅,徐彤,闰达远,王涌天,哈涌刚.增强现实中虚拟物体的投影注册算法研究北京理工大学学报,2000年12月,第20卷第6期:535～540.
[30]Konenderink, Van Doom. A Bine Structure from Motion. Journal of the Optical Society of America A, 1991,8(2):377～385.
[31]明德烈,柳健,田金文.仿射变换在增强现实中的应用.系统仿真学报,2001年11月,第13卷,增刊:286～289.
[32]周新伦,柳健,刘华志数字图像处理,第1版.北京:国防工业出版社,1986年6月.
[33]赵荣椿,赵忠明,崔更生.数字图像处理导论,第1版.西安:西北工业大学出版社,1995.
[34]贾志刚.精通OpenGL,第1版.北京:电子工业出版社,1998年.
[35]阳化冰,刘忠丽,刘忠轩,等.虚拟现实构造语言VRML,第1版.北京:北京航空航天大学出版社,2000年9月.
[36] 马颂德,张正友. 计算机视觉[M] .北京: 科学出版社,1998.
[37] 于建岗,裘正定.IP 网上多点会议系统中 MCU 的研究与实现. 现代电信科技,2001,(8):1-4
[38] 闫朝敏.基于 IP 分组网的视频会议系统的研究与实现[D] .南京:河海大学,2003.
[39] Dirk Reimers ,Didier Stricker ,Gudrun Klinker ,et al. Augmented Reality for Construction Tasks:Doorlock Assembly [C]. Proceedings of IWAR’98 ,1998.31-46.
[40] G. Klinker, D. Stricker, D. Reiners, "Augmented Reality: A Balancing Act Between High Quality and Real-Time Constraints", Proceedings of ISMR '99, 1999,pp.325-346.
[41]陈政.基于IP网络的视频会议系统的研究与实现.华南理工大学硕士学位论文,2001.3.
[42]谢树煌,马雁彬.分布式多媒体会议系统.计算机工程与应用,1995年第2期.
[43]蔡安妮,孙景鳌.多媒体通信技术基础[M]北京:电子工业出版社,2001.
[44]毕厚杰.多媒体信息的传输与处理.人民邮电出版社,1999.
[45]王子荣,杨贯中,胡峰松.基于IP的多媒体网络教学系统的研究与开发.湖南大学学报,2000年第3期.
[46]村山公保.TCP/IP网络实验程序篇[M].北京:科学出版社,2003
[47]吴敏.甚低码率视频图像编码技术的研究.河海大学硕士学位论文,2001.3.
[48]ITU-T/CCITT Recommendation. H.263 Video Coding for Low Bit Rate Communication, March 1996.
[49]R.J. Clarke. Transform Coding of Image. Academic Press, London, 1985
[50]贾铸. 算术编码方法在图像压缩编码中的应用.电视技术,1999年第11期.
[51]孙宇. H.263视频图像编码算法的研究与实现.河海大学硕士学位论文,2003.3.
[2]Mark Billinghurst, Hirokazu Kato, Weghorst S., et a]. A Mixed Reality 3D Conferencing Application. Technical Report R-99-1,Human Interface Technology Laboratory, University of Washington, 1999: 5～8.
[3]Billinghurst, Weghorst, S., Furness. Shared Space: An Augmented Reality Approach for Computer Supported Cooperative Work. Virtual Reality. 1998 vol 3(1):25～36.
[4] Mark Billinghurst. A wearable spatial conferencing space. In: Proc. ISWC'98,Montrdal, Canada. IEEE Press, Pitsburgh, Penn,USA, October 1998:76～83.
[5]周雅,闰达远,王涌天等.一种增强现实系统的三维注册方法.中国图像图形学报,2000年5月,第5卷(A版),第5期:430～433.
[6] Ronald Azuma,Yohan Baillot, Reinhold Behringer, et al. Recent Advances in Augmented Reality. IEEE Computer Graphics and Applications. 2001 November/ December: 34-47.
[7]ITU-T Recommendation H.323 Draft V4.Packet-based multimedia Communications systems,2000.
[8]陆讽,郁梅.视频会议系统及应用.微机发展,,2001年第1期.
[9]蒋林涛.多媒体通信网[M].北京:人民邮电出版社,1999.
[10](日)田村秀行等.计算机图像处理技术,第1版.赫荣威等编译.北京:北京师 范大学出版社.1988年9月.
[11](日)谷口庆治.数字图像处理[基础篇],第1版.朱虹,廖学成,乐静译.北 京:科学出版社.2002年.
[12]王育峰,杨寿保,孙适.基于新一代网络协议的IP电话技术.计算机工程与应用,2002.12.
[13]曹宁,马银松,胡建荣.IP网络视频会议中MCU的实现及其控制策略.计算机工程.2000年第5期.
[14]姜海东,胡绍海,裘正定.H323中关守的功能及实现,数据通信,1999年第4期.
[15]郝又超,王文东.基于H.323网守的呼叫中心模型设计.现代电信科技,2000年第6期.
[16]ITU-T Recommendation H.245 Control protocol for multimedia communications, 1996.
[17]Uyless Black著,良友翻译组译.TCP/IP及相关协议[M].北京:机械工业出版社,1998.
[18]卢政加.如何成功的运用Openh323来开发商业的H.323协议栈,2002.11.
[19]黄丽亚.基于H.323的IP电话信令.电信快报,2001年第5期.
[20] Ronald Azuma. A survey of Augmented Reality. Teleoperator and Virtual Environments. 1997, 6:355～385.
[21] H.L.Pryor, T.A.Fumess, E.Viirre. The Virtual Retinal Display: A Nes Display Technology Using Scanned Laser Light. In:Proc. 42 nd Human Factors ErgonomicsSoc.,1998, Santa Monica, Calif: 1570-1574.
[22] R.Raskar, GWelch, W-C.Chen. Table-Top Spatially-Augmented Reality: Bringing Physical Models to Life with Projected Imagery. In:Proc.2nd Int'l Workshop Augmented Reality(IWAR 99), IEEE CS Press, Los Alamitos, 1999, Calif: 64～71.
[23] Hong Hua, Chunyu Gao, Brown, et al. Using a head-mounted projective display in interactive augmented. in:Augmented Reality, 2001 Proceedings. IEEE and ACM International Symposium 2001:217～223.
[24]陈靖,王涌天,施琦等.增强现实系统的动态注册.北京理工大学学报,2001, 第21卷,第5期:631～636.
[25] Chavel, P.&Strand, P.. Range measurement using Talbot difraction imaging of gratings. Applied Optics, 23(6), 1984:862～870.
[26] Raab F., Bood, E. Steiner, O &Jones, H.. Magnetic position and orientation tracking system. IEEE Transactions on Aerospace and Electronics Systems, AES-15(5), 1979: 709～717.
[27]Thomas Auer, Axel Pinz. The integration of optical and magnetic tracking for mult-user augmented reality. Computers&Graphics, 1999 vol.23:805～808.
[28]T.Auer and A Pinz. Building a Hybrid Tracking System: Integration of Optical and Magnetic Tracking. In: Proc.of IEEE International Workshop on Augmented Reality. 1999:13～22.
[29]周雅,徐彤,闰达远,王涌天,哈涌刚.增强现实中虚拟物体的投影注册算法研究北京理工大学学报,2000年12月,第20卷第6期:535～540.
[30]Konenderink, Van Doom. A Bine Structure from Motion. Journal of the Optical Society of America A, 1991,8(2):377～385.
[31]明德烈,柳健,田金文.仿射变换在增强现实中的应用.系统仿真学报,2001年11月,第13卷,增刊:286～289.
[32]周新伦,柳健,刘华志数字图像处理,第1版.北京:国防工业出版社,1986年6月.
[33]赵荣椿,赵忠明,崔更生.数字图像处理导论,第1版.西安:西北工业大学出版社,1995.
[34]贾志刚.精通OpenGL,第1版.北京:电子工业出版社,1998年.
[35]阳化冰,刘忠丽,刘忠轩,等.虚拟现实构造语言VRML,第1版.北京:北京航空航天大学出版社,2000年9月.
[36] 马颂德,张正友. 计算机视觉[M] .北京: 科学出版社,1998.
[37] 于建岗,裘正定.IP 网上多点会议系统中 MCU 的研究与实现. 现代电信科技,2001,(8):1-4
[38] 闫朝敏.基于 IP 分组网的视频会议系统的研究与实现[D] .南京:河海大学,2003.
[39] Dirk Reimers ,Didier Stricker ,Gudrun Klinker ,et al. Augmented Reality for Construction Tasks:Doorlock Assembly [C]. Proceedings of IWAR’98 ,1998.31-46.
[40] G. Klinker, D. Stricker, D. Reiners, "Augmented Reality: A Balancing Act Between High Quality and Real-Time Constraints", Proceedings of ISMR '99, 1999,pp.325-346.
[41]陈政.基于IP网络的视频会议系统的研究与实现.华南理工大学硕士学位论文,2001.3.
[42]谢树煌,马雁彬.分布式多媒体会议系统.计算机工程与应用,1995年第2期.
[43]蔡安妮,孙景鳌.多媒体通信技术基础[M]北京:电子工业出版社,2001.
[44]毕厚杰.多媒体信息的传输与处理.人民邮电出版社,1999.
[45]王子荣,杨贯中,胡峰松.基于IP的多媒体网络教学系统的研究与开发.湖南大学学报,2000年第3期.
[46]村山公保.TCP/IP网络实验程序篇[M].北京:科学出版社,2003
[47]吴敏.甚低码率视频图像编码技术的研究.河海大学硕士学位论文,2001.3.
[48]ITU-T/CCITT Recommendation. H.263 Video Coding for Low Bit Rate Communication, March 1996.
[49]R.J. Clarke. Transform Coding of Image. Academic Press, London, 1985
[50]贾铸. 算术编码方法在图像压缩编码中的应用.电视技术,1999年第11期.
[51]孙宇. H.263视频图像编码算法的研究与实现.河海大学硕士学位论文,2003.3.