摘要
空间机器人及其遥操作技术是目前主要航天大国研究的重点技术之一,它对提高国家在空间领域的竞争力和安全性具有重要的意义。空间机器人遥操作对信息反馈的实时性和准确性有着更为严格的要求,信息反馈的延迟或误差会影响操作人员的正确判断,导致控制失败,造成重大的经济损失。本文针对解决空间机器人遥操作中时延问题的预测显示控制方式,提出一种并行分布式的增强现实场景构建系统,构造空间舱内机器人遥操作的增强现实仿真场景。该场景构建系统通过构建高处理能力体系结构、设计快速高精度虚拟机器人注册算法以及多层次的虚实遮挡关系检测算法,实现虚拟机器人与空间舱内真实场景的全方位配准和可靠融合,并通过图像拼接技术和宽视场角显示系统对融合场景进行显示,为空间舱内机器人遥操作提供实时、准确、清晰的增强仿真信息。主要研究内容包括:
第一,针对目前增强现实技术在处理性能上的不足,在对空间舱内机器人遥操作环境特点进行分析的基础上提出了一种面向空间舱内机器人遥操作预测仿真的并行分布式增强现实系统体系结构,并对并行结构所涉及的同步控制机制和通讯系统的实现方式等进行了深入研究。该并行分布式结构基于空间舱内环境固定可测的特点,通过多通道并行处理能够为操作人员提供实时、高分辨率、宽视场角、高沉浸感的增强场景预测立体显示。
第二,基于直接线性变换(DLT)标定算法提出了一种快速精确的相机标定方法,并对其在增强现实虚实注册中的注册误差与Tsai两步标定算法进行了实验对比。该方法采用直接线性变换法进行摄像机标定和注册,不需要对拍摄图像进行畸变校正,可以提高系统的处理速度;同时,由于标定的测量体基本覆盖单个摄像机所对应的整个有效注册空间,因此即便采用不考虑畸变的DLT算法也可以获得较高的虚实对齐精度,能够为观察者提供可靠的相对位置关系。
第三,针对目前虚实注册技术没有统一评价标准,对于不同类型的注册技术通常很难进行定量评估来判定技术优劣的问题,提出了一套虚实注册技术评价指标。此评价指标分为与注册质量相关和与系统需求相关两个方面,分别对注册技术的固定注册精度、注册空间大小、注册计算量、注册鲁棒性、硬件成本、前期工作量以及适用性等项目进行评测。这套评价指标可以用来对特定的虚实注册技术进行全面综合的评价。
第四,提出了一种快速高精度多层次遮挡检测算法来实现增强现实系统中虚实投影间快速鲁棒的多层次遮挡检测。其中,基本双目立体匹配虚实遮挡算法通过比较虚实投影的相对位置来判定虚实空间点间的遮挡显示状态,不需要进行深度重构计算,可以提高遮挡检测效率;基于顶点显示状态在时间和空间上的连续性提出的状态拟合算法能够解决特征匹配失败顶点的状态检测问题;有效边点检测算法利用顶点邻接边上高可靠性边点代替低可靠性邻接顶点进行状态拟合运算能有效提高状态拟合算法的精度;最后,通过对检测出的显示状态进行整体连续性优化能够改善虚实融合图像的连续性效果。
第五,本文采用基于图像绘制(IBR)的图像拼接技术来获得宽视场的增强仿真场景图像。针对目前的图像配准技术都是面向通用图像拼接,效率和精度都比较低,不能满足多路视频流之间实时精确的无缝拼接要求,提出了一种基于相机标定和相位相关相结合的图像配准拼接算法,利用相机标定信息和傅立叶变换的平移特性实现场景深度范围一定的多路视频流间实时高精度的无缝拼接。该配准算法利用精确的相机标定信息来实现图像间的旋转和缩放变换,对图像配准的准确度有很大改善。同时算法在预处理阶段就已经确定了图像的旋转缩放变换矩阵,实时处理阶段直接进行矩阵运算,避免了对数极坐标变换和反复的FFT正向、逆向操作,极大地提高了处理速度,使拼接算法具有非常好的实时性。
最后,基于所设计的场景构建系统设计了简单的舱内机器人遥操作场景仿真实验原型。实验结果证明了系统设计的正确性和有效性。
Now, space robotics and its tele-operation technology have become the most important research areas in many countries with advanced aerospace technology, and make great sense in enhancing country's competition ability and security in space area. Because of the particularity and significance of its application areas, tele-operation of space robot has severe demand on the speed and accuracy of information's feedback. The delay and error of information feedback can misguide operator's judgment, and probably lead to control failure and great economy loss. Aiming at the time delay problem in space robot's tele-operation, this research advanced a parallel and distributed augmented reality(AR) simulation scene construction system to construct augmented simulation scene for tele-operation of space robot in cabin real time and reliably. This scene construction system realized complete alignment and reliable fusion of virtual robot model and real scene of space cabin by constructing high performance architecture, using fast and precise calibration and registration method and designing multi-layer occlusion detecting algorithm. And at the same time, image mosaic technology and large field-of-view 3D display system are used too to realize large field-of-view and high immersion display of the fusion scene. Thus, real time, precise and immersive simulation information can be obtained for tele-operation of space robot in cabin. Main research contents include:
Firstly, a parallel and distributed architecture of AR simulation scene construction is advanced base on that the robot tele-operation environment in space cabin is fixed and measurable. The related synchronization control mechanism and network communication techniques are researched. This kind of architecture can provide high performance process platform for reliable and immersive AR simulation scene construction.
Secondly, full experiments and detailed analysis are made on registration error of AR for Direct Line Transformation(DLT) calibration algorithm and Tsai two steps calibration algorithm respectively, and a fast and accurate camera calibration method is put forward based on the experiment results. This calibration method realizes fast calibration and registration by using DLT algorithm which don't need to do aberration correction, and realizes accurate registration by making the measurement volume occupy whole camera's effective registration space.
Thirdly, to resolve the problem that there isn't any uniform evaluation standard of AR's 3D registration technique and it's difficult to make quantitative evaluation to compare the performance of different registration algorithms, a set of evaluation factors relative virtual-real registration are concluded and identified. These factors include stationary registration accuracy, registration space size, computation cost, algorithm's robustness, hardware cost, preparation labor and system applicability etc. all these factors can be classified into to categories: one is concerning the registration quality, and the other is concerning the system's requirements.
Fourthly, a fast and accuracy multi-layer occlusion detecting algorithm is put forward to realize real time and robust multi-layer occlusion detection between virtual and real projections in augmented reality system. The basic occlusion detecting algorithm based on geometry stereo matching has low computation cost by avoiding deepness calculation. Based on display status' spatio-temporal continuity, status combining algorithm is advanced to resolve occlusion detecting of points whose feature matching is unsuccessful. The effective edge points detecting algorithm is designed to increase the accuracy of status combining algorithm by using higher reliable edge points to do status combination. And finally, unitary continuity optimization is done on all points to improve the display quality of fusion image.
Fifthly, large field-of-view AR simulation scene is obtained by image mosaic in Image-based Rendering technology. Aiming at the problem that current image alignment methods for normal images can not achieve speed and accuracy requirements for real-time and seamless mosaic among multiple video streams, an image mosaic solution based on camera calibration and phase correlation is put forward. Camera's calibration information and FFT's translation feature are used together to realize fast and seamless image mosaic among multiple video streams whose effective depth scale of scene is relatively small. This solution's good accuracy comes from the precise calibration parameters, and the fast speed is obtained by avoiding repetitious FFT and IFFT computation.
Finally, a simple experiment prototype of AR scene construction system for tele-operation of space robot in cabin is realized. The experiment results proved the correctness and validity of the system design.
引文
[1]MchBarron Ⅱ.Past,Present,and Future:the U.S.EVA Program[J].Acta Astronautica,1994,32(1):5-14
[2]Hirzinger G,Brunner B.DLR Advances in Orbital Robotics[C].Proceedings of IEEE International Conference On Robotics & Automation,San Francisco,CA,April 2000:898-907
[3]蒋新松.未来机器人技术的发展方向[J].机器人技术及应用,1997,2:2-5
[4]Hirzinger G,Brunner B,Dietrich J,et al.ROTEX-The First Remotely Controlled Robot in Space[C].Proceedings of IEEE International Conference on Robotics and Automation,San Diego,CA,1993:2604-2611
[5]Hirzinger G,Landzettel K,Fagerer C.Telerobotics with Large Time Delays-the ROTEX Experience[C].Proceedings of IEEE/RSJ/GI International Conference on Intelligent Robots and Systems,Munich,Germany,1994:571-578
[6]Hirzinger G.Multisensory Shared Autonomy and Tele-Sensor Programming-Key Issues in Space Robotics[J].Robotics and Autonomous Systems,1993,11:141-162.
[7]Visentin G.An Overview of Mission Applications for Space A&R[R].Noordwijk,Netherlands:ESTEC,2004
[8]King D.Space Servicing:Past,Present and Future[R].I-SAIRAS,2001
[9]Piedboeuf J C,Dupuis(?).Recent Canadian Activities in Space Automation &Robotics-an Overview[R].Noordwijk,Netherlands:ESTEC,2002
[10]Tsutomu Iwata.Current Status of Space Robotics Activities in Asia[R].Nara,Japan:I-SAIRAS,2003
[11]Naumann W,F(o|¨)rster K P,Moldenhauer W,et al.Upgrading of Sophisticated Industrial Robotic Joints for Space Applications[R].Noordwijk,Netherlands:ESTEC,2002
[12]Stieber M E,Mckay M.,Vukovich and G,et al.Vision-based Sensing and Control for Space Robotics Applications[J].IEEE Transactions on Instrumentation and Measurement,1999,48(4):807-812
[13]Machida K,Mikami T.Precise EV Robot:Flight Model and Telerobotic Operation for ETS-Ⅶ[C].Proceedings of IROS 96,1996:1550-1557
[14]Sommer B,Turk M.Unmanned On-orbit Servicing(OOS),Rokviss and the TECSAS Mission[R].Noordwijk,Netherlands:ESTEC,2004
[15]梁斌.空间机器人双臂协调柔顺控制与仿真[R].中国国防科学技术报告,中国空间技术研究院502所,1999
[16]Sheridan T B.Space Teleoperation through Time Delay:Review and Prognosis[J].IEEE Transactions on Robotics and Automation,1993,9(5):592-606
[17]Nagatomo M,Harada C,Hisadome Y.Operation of Crew-tended Space Robot in MFD[C].Proceedings of 41st Space Sciences and Technology Conference,1997:97-15-11
[18]Hirzinger G,Brunner B,Dietrich J.Sensor-Based Space Robotics-ROTEX and Its Telerobotic Features[J].IEEE Transactions on Robotics and Automation,1993,9:649-663
[19]陈俊杰.空间机器人遥操作克服时延影响的研究进展[J].测控技术,2007,26(2):1-4+7
[20]庄骏,邱平,孙增圻.大时延环境下的分布式遥操作系统[J].清华大学学报(自然科学版),2000,40(1):80-83
[21]樊滨温,张炯,蔡鹤皋,等.遥操作空间机器人系统研究[J].哈尔滨工业大学学报,1999,31(1):111-114
[22]李成,梁斌.空间机器人的遥操作[J].宇航学报,2001,22(1):95-98
[23]朱广超,王田苗,丑武胜,等.基于增强现实的机器人遥操作系统研究[J].系统仿真学报,2004,16(5):943-946
[24]Oda M,Inaba N,Fukushima Y.Space Robot Technology Experiments on NASDA's ETS-Ⅶ Satellite[J].Advanced Robotics,1999,13(3):335-336
[25]Anderson R J,Spong M W.Bilateral Control of Teleoperation with Time Delay[J].IEEE Transactions on Automation Control,1989,34(3):494-503
[26]ScheborF S,Turney J L.Realistic and Consistent Telerobotic Simulation[C].Proceedings of IEEE International Conference on Robotics and Automation,Atlanta,USA,1991:889-894
[27]Goertz R C.Manipulator System Development at ANL[C].Proceedings of the 12th Remote Systems Technology Conference,Argonne National Laboratory,ANS,1964:117-36
[28]http://www.bnl.gov/world/Default.asp
[29]Taylor K,Dalton B.Internet Robots:A New Robotics Niche[J].IEEE Robotics &Automation Magazine.2000,7(1):27-34
[30]Lumina R.Using NASREM for Real-time Sensory Interactive Robot Control[J].Robotica,1994,12(2):127-135
[31]Hirzinger G.Robot in Space:A Survey[J].Advanced Robotics,1995,9(6):625-651
[32]Burdea G C.Invited Review:The Synergy between Virtual Reality and Robotics[J].IEEE Transactions on Robotics and Automation,1999,15(3):400-410
[33]景兴建,王越超,谈大龙.遥操作机器人系统时延控制方法综述[J].自动化学报,2004,30(2):214-223
[34]王清阳,席宁,王越超.基于谓词不变性的状态反馈控制在机器人遥操作中的应用[J].机器人,2003,25(5):428-432
[35]李焱,韦庆,贺汉根.一个面向遥科学实验的遥操作实验系统[J].宇航学报,2001,22(6):106-109
[36]Chang Sokho,Kim Jungtae.KIST Teleoperation System for Humanoid Robot[C].Proceedings of the 1999 IEEE/RSJ International Conference on Intelligence Robots and Systems.Kyongju,South Korea,1999:1198-1203
[37]Bar-Cohen Y,Mavroidis C,Bouzit M.Virtual Reality Robotic Telesurgery Simulations Using MEMICA Haptic System[C].Smart Structures and Materials 2001:Electroactive Polymer Actuators and Devices,Newport Beach,CA,USA,5-8March,2001:4329-4347
[38]Ferrel W R.Delayed Force Feedback[J].IEEE Transactions on Human Factors,1996,9(5):449-454
[39]Keyvan Hashtrudi-Zaad,Septimiu E.Architectures for Teleoperation Systems with Impedance/Admittance Master and Slave Manipulators[J].The International Journal of Robotics Research,2001,20(6):419-445
[40]Leung G M H,Francis B A.Bilateral Controller for Teleoperators with Time Delay via μ-synthesis[J].IEEE Transactions on Robotics and Automation,1995,11(1):105-116
[41]宋爱国,蒋洪明等.临场感遥控作业机器人的力觉虚拟现实建模研究[J].测控技术,2000,19(9),51-54
[42]Lim Ser Yong,Wong Hong Yang.Robot Task Execution with Telepresence Using Virtual Reality Technology[C].Proceedings of International Conference on Mechatronic Technology,Hsinchu,Taiwan,R.O.C,Nov 30-Dec 2,1998:1-8
[43]Raju G.Design Issue in 2-port Networks Models of Bilateral Remote Manipulation[J].IEEE Transactions on Automatic Control,1989,34(3):1316-1321
[44]Anderson R J,Spong M W.Bilateral Control of Teleoperators with Time Delay[J].IEEE Transactions on Automatic Control,1989,34(5):494-501
[45]Niemeyer G,Slotine J-JE.Using Wave Variables for System Analysis and Robot Control[C].Proceedings of 1997 IEEE International Conference on Robotics and Automation.New Mexico,1997:1619-1625
[46]Niemeyer G,Slotine J-JE.Towards Force-reflecting Teleoperation over the Internet[C]Proceedings of 1998 IEEE International.Conference on Robotics and Automation,Belgium,1998:1909-1915
[47]Niemeyer G,Slotine J-JE.Stable Adaptive Teleoperation[J].IEEE Journal of Oceanographic Engineering,1991,16(1):152-162
[48]Sheridan T B Telerobotics and Human Supervisory Control[M].The MIT Press,1992
[49]Blackmon T,Stark L.Model-based Supervisory Control in Telerobotics[J].Presence-Teleoperation and Virtual Environment,1996,5(2):205-223
[50]Sheridan T B.Human Supervisory Control of Robot Systems[C].Proceedings of the IEEE International Conference on Robotics and Automation,Georgia,USA,1986:808-812
[51]Conway L,Voiz R.Teleautonomous Systems:Projecting and Coordination Intelligent Action at a Distance[J].IEEE Transactions on Robotics and Automation,1990,6(2):146-158
[52]Elhajj I,Xi N,Liu Y.Real-time Control of Internet based Teleoperation with Force Reflection[C].Proceedings of the IEEE International Conference on Robotics and Automation,San Francisco,CA,April 2000:3284-3289
[53]Xi N,Tam T J.Action Synchronization and Control of Intemet based Telerobotic Systems[C].Proceedings of the IEEE International Conference on Robotics and Automation,Detroit,Michigan,May 1999:2964-2969
[54]Elhajj I,Tan J,Xi N,et al.Multi-Site Internet-based Cooperative Control of Robotic[C].Proceedings of the IEEEI/RSJ International Conference on Intelligent Robotics and Systems,2000:826-831
[55]Elhajj I,Tan J,Xi N,et al.Internet Based Cooperative Teleoperation[J].International Workshop on Bio-Robotics and Teleoperation,2001:84-91
[56]Elhajj I,Xi N,Fung W K,et al.Modeling and Control of Internet Based Cooperative Teleoperation[C].Proceedings of the IEEE International Conference on Robotics and Automation,2001:662-667
[57]Bob Bicker,Ow Sin Ming.Shared Control in Bilateral Telerobotic Systems[J].Telemanipulator and Telepresence Technologies,1994,2351:200-206
[58]Funda,Paul R P.Teleprogramming:Overcoming Communication Delays in Remote Manipulation[C].Proceedings of the IEEE International Conference on Systems,Man and Cybernetics,1990:873-875
[59]Brunner B,Landzetel K,Schreiber G,et al.A Universal Task-level Ground Control and Programming System for Space Robot Applications[C]. Proceedings of I-SAIRAS 5th International Symposium on Artificial Intelligence, Robotics and Automation in Space, Noordwijk, 1999:1-8
[60] Yerex K, Cobzas D, Jagersand M. Predictive Display Models for Tele-manipulation from Uncalibrated Camera Capture of Scene Geometry and Appearance[C]. Proceedings of the IEEE International Conference on Robotics and Automation, 2003: 2812-2817
[61] Marin R, Sanz P J. A Predictive Interface Based on Virtual and Augmented Reality for Task Specification in Web Telerobotic System[C]. Proceedings of the 2002 IEEE/RSJ International Conference on Intelligent Robots and Systems EPFL, Lausanne, Switzerland, October 2002:3005-3010
[62] Hirzinger G, Brunner B, Dietrich J, et al. Sensor-Based Space Robotics-ROTEX and its Telerobotics Features[J]. IEEE Transactions on Robotics and Automation, 1993, 9(5): 649-663
[63] Hirzinger G, Landzetel K, Fagerer Ch. Telerobotics with Large Time Delays-the ROTEX Experience[C]. Proceedings of the IEEE/RSJ International Conference on Intelligent Robotics and Systems, Nagoya, 1994:571-578
[64] Funda, Paul R P, Efficient Control of a Robotic System for Time Delayed Environment[C]. Proceedings of the IEEE International Conference on Advanced Robotics, 1991:219-224
[65] Noyes M, Sheridan T B. A Novel Predictor for Telemanipulation through a Time Delay[C]. Proceedings of International Conference on Systems, Man and Cybernetics. 1984: 88-96
[66] Bejczy, Venema S, Kim W. Role of Computer Graphics in Space Telerobotics: Preview and Predictive Displays[J]. SPIE Volume 1387 Cooperative Intelligent Robotics in Space, 1990: 365-377
[67] Conway L, Volz R, Walker M. Tele-Autonomous Systems: Methods and Architectures for Intermingling Autonomous and Telerobotic Technology[C]. Proceedings of International Conference on Robotics and Automation, 1987(3): 1121-1130
[68] Burden G C. The Synergy between Virtual Reality and Robotics[J]. IEEE Transactions on Robotics and Automation, 1999, 15(3):400-410
[69] Conway L, Voiz R. Teleautonomous Systems: Projecting and Coordination Intelligent Action at a Distance[J]. IEEE Transactions on Robotics and Automation, 1990, 6(2):46-158
[70] Rosenberg L. The Use of Virtual Fixtures to Enhance Telemanipulation with Time Delay[C]. Proceedings of ASME WAM, 1993,49:29-36
[71] Tachi S, Kawakami N, Inami M, et al. Mutual Telexistence System using Retro-reflective Projection Technology[J]. International Journal of Humanoid Robotics, 2004,1(1): 45-64
[72] Kirsch B. Robots and Simulated Environments-First Steps towards Virtual Robotics[C]. ISBN: 0-8186-4910-0/93. IEEE, 1993:122-123
[73] Laurent A, Nguyen, Maria Bualat. Virtual Reality Interfaces for Visualization and Control of Remote Vehicles[J]. Autonomous Robots, 2001(11):59-68
[74] Stuart McLachlan, Emmanouel Papaioannou. Robotic Simulation using Virtual Reality[J]. Virtual Reality and Supercomputing Automotive Applications, 1999: 357-364
[75] Tsumaki Y, Hoshi Y, Naruse H, et al. Virtual Reality Based Teleoperation which Tolerates Geometrical Modeling Errors[C]. Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. Osaka, Japan, 1996:1023-1030
[76] Tsumaki Y, Uchiyama M. A Model-Based Space Teleoperation System with Robustness against Modeling Errors[J]. Proceedings of IEEE International Conference on Robotics and Automation, Albuquerque, NM, USA, 1997:1594-1599
[77] Tomotaka I, Koji Y, Shinsuke I, et al. New Predictive Display Method of Motion and Force Information for Network Teleoperation without Using Virtual Environment Model[C]. Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems, Lasvegas, Nevada, 2003:2815-2822
[78] Ronald Azuma, Yohan Baillot, Reinhold Behringer, et al. Recent Advances in Augmented Reality[J]. IEEE Computer Graphics and Applications, 2001:34-47
[79] Azuma Ronald. A survey of Augmented Reality[J]. Teleoperator and Virtual Environments, 1997, 8(6):355-385
[80] Milgram, Kishino. A Taxonomy of Mixed Reality Visual Displays[J]. IEICE Transactions on Information Systems, 1994, E77-D(12):1321-1329
[81] Pentenrieder K, Meier P. The Need for Accuracy Statements in Industrial Augmented Reality Applications[C]. Proceedings of Sixth International Symposium on Mixed and Augmented Reality, 2007
[82] Yamashita Masaya, Sakane Shigeyuki. Adaptive Annotation Using a Human-Robot Interface System PARTNER[C]. Proceedings of the 2001 IEEE International Conference on Robotics and Automation, Seoul, Korea, 2001(5): 21-26
[83] Blackwell Mike, Nikou Constantinos. An Image Overlay System for Medical Data Visualization[J].Medical Image Analysis.2000:67-72
[84]Noyes M.Superposition of Graphics on Low Bit-rate Video as An Aid to Teleoperation[D].MIT Master Degree Thesis,1984
[85]Bejczy A K,Kim W S.The Phantom Robot:Predictive Display for Teleoperation with Time Delay[C].Proceedings of IEEE International Conference on Robotics and Automation,1990:546-551
[86]Kim W S,Bejczy A K.Commercialization of JPL Virtual Reality Calibration and Redundant Manipulator Control Technologies[C].Proceedings of the International Symposium on Artificial Intelligence,Robotics and Automation in Space.Nagoya,Japan,1994:23-26
[87]Kim W S,Schenker P,Bejczy A K,et al Advanced Graphics Interfaces for Telerobotic Servicing and Inspection[C].Proceedings of IEEE/RSJ International Conference on Intelligent Robotics and Systems,1993,Yokohama:303-309
[88]Kim W S.Graphical Operator Interface for Space Telerobotics[C].Proceedings of IEEE International Conference on Robotics and Automations,1993:761-768
[89]Kim W S,Gennery D B,E C Chalfant.Computer Vision Assisted Virtual Reality Calibration[C].Proceedings of IEEE International Conference on Robotics and Automations,Apr.1997:1335-1340
[90]Kim W S,Bejczy A K.Graphic Displays for Operator Aid in Telemanipulation[C].Proceedings of IEEE International Conference on Systems,Man and Cybernetics,Charlottesville,VA,USA,1991:1059-1067
[91]Kim W S.Computer Vision Assisted Virtual Reality Calibration[J].IEEE Transactions on Robotics and Automation.1999,15(31):450-464
[92]Casals A,Fernandez J,Amat J.Augmented Reality to Assist Teleoperation Working with Reduced Visual Conditions[C].Proceedings of IEEE International Conference on Robotics and Automation.Washington D C,2002:235-240
[93]Milgram Paul,Zhai Shumin.Applications of Augmented Reality for Human-Robot Communication[C].Proceedings of the 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems,Yokohama,Japan,July,1993:26-30
[94]Otmane S,Mallem M.Cooperative Remote Control using Augmented Reality[C].Proceedings of 1st IFAC-Conference on Telematics Applications in Automation and Robotics TA 2001,Weingarten,Germany,24-26 July,2001:203-208
[95]刘伟军,朱枫,董再励.虚拟现实辅助机器人遥操作技术研究[J].机器人,2001,23(5):385-390
[96]庄竣,邱平等.大时延分布式遥操作机器人地面仿真系统[C].空间机器人及遥科学 技术研讨会论文集,山东烟台,1999年8月
[97]丑武胜,孟纆,王田苗.基于多通道增强现实的机器人遥操作技术研究.高技术通讯,2004,10:49-52
[98]朱广超,王田苗,丑武胜等.基于增强现实的机器人遥操作系统研究[J].系统仿真学报.2004,5(5):943-946
[99]王涌天.增强现实研究进展[R].光电工程系,北京理工大学,北京,2005
[100]陈靖.视频增强现实系统及其核心技术的研究[R].光电工程系,北京理工大学,北京2002:133
[101]陈靖,王涌天,施琦,闫达远.增强现实系统的动态注册[J].北京理工大学学报,2001,21(5):631-636
[102]周雅,闫达远,王涌天,常红,徐彤.一种增强现实系统的三维注册方法[J].中国图象图形学报,2000,5(A5):430-433
[103]管涛,李利军,段利亚,等.基于标识与平面间单应性矩阵的虚实注册方法[J].华中科技大学学报(自然科学版),2006,34(10):55-57
[104]管涛,李利军,段利亚,等.基于全局单应性变换的虚实注册方法[J].华中科技大学学报(自然科学版),2007,35(4):100-102
[105]李利军,杨西平.基于标识与自然纹理特征的三维注册方法研究[J].计算机技术与发展,2007,17(7):77-83
[106]Yuan M L,Ong S K,Nee A Y C.Registration Using Natural Features for Augmented Reality Systems[J].IEEE Transactions on Visualization and Computer Graphics.2006,12(4):569-580
[107]Kutulakos K,Vallino J R.Calibration-free Augmented Reality[J].IEEE Transactions on Visualization and Computer Graphics,1998,4(1):1-20
[108]Kutulakos K N,Vallino J.Affine Object Representations for Calibration-Free Augmented Reality[C].Proceedings of the IEEE 1996 Virtual Reality Annual International Symposium,Santa Clara,CA,30 March-3 April,1996:25-36
[109]明德烈,柳健,田金文.仿射变换在增强现实中的应用[J].系统仿真学报,2001,13(增刊B):286-289
[110]明德烈,柳健,田金文.增强现实中的虚实注册技术研究[J].中国图象图形学报,2003,8(5):557-561.
[111]郑文庭.基于几何和图象混合的虚拟场景实时绘制技术研究[D].博士论文,1999,浙江大学,杭州
[112]Wang Y,Samaras D.Estimation of Multiple Illuminants from a Single Image of Arbitrary Known Geometry[C].Proceedings of 7th European Conference on Computer Vision(ECCV'02),2002
[113]Sato I,Sato Y,keuchi K.Illumination Distribution from Shadows[C].Proceedings of IEEE Conference on Computer Vision and Pattern Recognition(CVPR'99),1999
[114]孙其民,吴恩华.全局光照环境中的逆向绘制[J].软件学报,2003,14(10):1796-1805
[115]Kanbara M,Yokoya N.Real-time Estimation of Light Source Environment for Photorealistic Augmented Reality[C].Proceedings.of 17th International Conference on Pattern Recognition(ICPR'04),2004
[116]Diverdi S,Hollerer T.Combing Dynamic Physical and Virtual Illumination in Augmented Reality[R].Department of Computer Science,University of California,Santa Barbara.,2004
[117]吴向阳,彭群生,张宏鑫等.实时全局重光照算法[J].软件学报,2004.15(6):960-967
[118]Shinichi Noda,Yoshihiro Ban.An Optical See-Through Mixed Reality Display with A Real Time Range Finder and An Active Pattern Light Source[J].Transactions of the Virtual Reality Society of Japan,1999,4(4):665-679
[119]Kiyokawa K,Kurata Y,Ohno H.An Optical See-Through Display for Mutual Occlusion of Real and Virtual Environments[C].Proceedings of IEEE and ACM International Symposium on Augmented Reality,OCT 5-6,2000:60-67
[120]Kiyokawa K,Kurata Y,Ohno H.Occlusive Optical See-Through Displays in a Collaborative Setup[C].Proceedings of the ACM SIGGRAPH 2002,Conference Abstracts and Applications,2002:74
[121]Bimbe O,Frohlich B.Occlusion Shadows:Using Projected Light to Generate Realistic Occlusion Effects for View-Dependent Optical See-Through Displays[C].Proceedings of International Symposium on Mixed and Augmented Reality.30 SEPT -1 OCT,2002:186-319
[122]Mulder J D,Liere R V.The Personal Space Station:Bringing Interaction within Reach[C].Proceedings of VRIC 2002,2002:73-81
[123]Oliver Bimber.Spatial Augmented Reality[C].SIGGRAPH 2007
[124]Piekarski.An Object-Oriented Software Architecture for 3D Mixed Reality Applications[C].Proceedings of the Second IEEE and ACM International Symposium on Mixed and Augmented Reality,2003
[125]Piekarski.An Architecture for Outdoor Wearable Computers to Support Augmented Reality and Multimedia Applications[C].Proceedings of 3rd International Conference on Knowledge-Based Intelligent Information Engineering Systems,Adelaide,SA,Aug,1999:70-73
[126]Bauer M.Design of a Component-Based Augmented Reality Framework[C].Proceedings of the 2nd International Symposium on Augmented Reality(ISAR),New York,2001
[127]Szalavari Z.Studierstube:An Environment for Collaboration in Augmented Reality[J].Virtual Reality,1998,3:37-48
[128]Open Inventor Toolkit,http://www.sgi.com/software/inventor/,2003
[129]Reitmayr D S G.OpenTracker:An open Software Architecture for Reconfigurable Tracking based on XML[C].Proceedings of the ACM Symposium on Virtual Reality Software and Technology(VRST),2001:285-286
[130]Bauer M.Integrating Studierstube and DWARF[C].Proceedings of International Workshop on Software Technology for Augmented Reality Systems,Tokyo,Japan.Oct.7,2003
[131]Coelho.OSGAR:A Scene Graph with Uncertain Transformations[C].Proceedings of International Symposium on Mixed and Augmented Reality(ISMAR04),Washington D C,USA,2004
[132]OpenSG,http://www.openSG.org,2005
[133]Ohlenburg J.The MORGAN Framework:Enabling Dynamic Multi-User AR and VR Projects[C].Proceedings of ACM Symposium on Virtual Reality Software and Technology(vRST2004),2004:166-169
[134]Szeliskir,Video Mosaics for Virtual Environments[J].IEEE Computer Graphics and Applications,1996,16(2):22-30
[135]贾庆轩,宋荆洲,孙汉旭等.高临场感多投影面虚拟环境系统的设计与实现[J].中国工程科学,2006,8(8):33-38
[136]蒋东兴等.Windows Sockets网络程序设计大全[M].清华大学出版社,1999
[137]郭蕴华,陈定方.面向分布式虚拟设计的协同工作环境研究[J].计算机辅助设计与图形学学报,2005,17(1):143-150
[138]马颂德,张正友.计算机视觉——计算理论与算法基础[M].北京:科学出版社,2003
[139]Tsai R Y.A Versatile Camera Calibration Technique for High Accuracy 3D Machine Vision Metrology Using Off-The-Shelf TV Cameras and Lenses[J].IEEE Journal of Robotics and Automation,1987,RA-3(4):323-344
[140]Ansar A,Rodriques D,Desai J P,et al.Visual and Haptic Collaborative Tele-Presence[J].Computers and Graphics.October 2001,25(5):789-798
[141]Kato Hirokazu,Billinghurst Mark.Marker Tracking and HMD Calibration for a Video-based Augmented Reality Conferencing System[C].Proceedings of 2nd IEEE and ACM International Workshop on Augmented Reality,Oct 20-21,1999:85-94
[142]Fuchs Henry,Gary Bishop,Kevin Arthur,et al.Virtual Space Teleconferencing Using a Sea of Cameras[R].Technical Report TR-94-033,University of Nortb Carolina at Chapel Hill,Department of Computer Science,Chapel Hill,NC,June,1994
[143]Wloka,Matthias M,Anderson.Resolving Occlusion in Augmented Reality[C].Proceedings of the Symposium on Interactive 3D Graphics,April 9-12,1995:5-12
[144]David E,Breen,Ross T.Interactive Occlusion and Automatic Object Placement for Augmented Reality[C].Proceedings of EUROGRAPHICS'96 on Computer Graphics Forum,1996,15(3):11-22
[145]Berger M O.Resolving Occlusion in Augmented Reality:a Contour Based Approach without 3D Reconstruction[C].Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition,Jun,1997:91-96
[146]Jan Fischer,Holger Regenbrecht,Gregory Baratoff.Detecting Dynamic Occlusion in front of Static Backgrounds for AR Scenes[C].Proceedings of the Workshop on Virtual Environments,May,2003:153-161
[147]Livingston M A,Swan J E.Resolving Multiple Occluded Layers in Augmented Reality[C].Proceedings of 2nd IEEE and ACM International Symposium on Mixed and Augmented Reality,Oct,2003:56-65
[148]Shen Jie,Wu Yonghong,Liu Haowu.Resolving Occlusion Problem in Augmented Reality[J].Journal of University of Electronic Science and Technology of China.2001,30(3):236-240+249
[149]庄宁.虚拟演播室中遮挡技术的实现[D].硕士学位论文,2002:34-43
[150]Fuhrmann A,Hesina G,Faure F,et al.·Occlusion in Collaborative Augmented Environments[J].Computers and Graphics,1998,23(6):809-819
[151]Yokoya N,Takemura H,Okuma T,et al.Stereo Vision Based Video See-through Mixed Reality[C].Proceedings of the 1st International Symposium on Mixed Reality,Yokohama,1999:85-94
[152]倪剑,闫达远,周雅,等.增强现实系统中的深度检测技术研究[J].计算机应用,2006,26(1):132-137
[153]Lepetit V,Berger M O.A Semi-automatic Method for Resolving Occlusion in Augmented Reality[C].Proceedings of IEEE Conference on Computer Vision and Pattern Recognition,Hilton Head Island,South California,2000:2225-2230
[154]朱杰杰,潘志庚.用视觉计算实现视频增强现实遮挡处理[J].计算机辅助设计与图形学学报,2007,19(12):1624-1628
[155]Claude Duchesne,Jean-Yves Herv(?).A Regularized Technique for Real-time Interposition of 3D Objects in Augmented Reality[C].Proceedings of IEEE International Conference on Systems,Man and Cybernetics,2005,2:1402-1408
[156]Blake A,Zisserman A.Visual Reconstruction[M].MIT Press,Cambridge,MA,1987
[157]王娟,师军,吴宪祥.图像拼接技术综述[J].计算机应用研究,2008,25(7):1940-1943
[158]赵文彬,张艳宁.角点检测技术综述[J].计算机应用研究,2006,23(10):17-19
[159]刘小军,周越.基于轮廓特征的SAR图像自动配准[J].计算机工程,2007,33(4):176-178
[160]Li Hui,Mitra S K..A Contour-based Approach to Multisensor Image Registration[J].IEEE Transactions on Image Processing,1995,4(3):320-334
[161]Brown M,Lowe D G.Invariant Features from Interest Point Group[C].Proceedings of British Machine Vision Conference,Cardiff Wales,2002:656-665
[162]Lowe D G.Distinctive Image Features from Scale-invariant Keypoints[J].International Journal of Computer Vision,2004,60(2):91-110
[163]Mount Dvaid M,Netanyahu Nathan S.Efficient Algorithm for Robust Feature Matching[J].Pattern Recognition,1999,32:17-38
[164]Kuglin C D,Hines D C.The Phase Correlation Image Alignment Method[C].Proceedings of IEEE Conference on Cybernetics and Society,New York,September,1975:163-165
[165]Reddy S.An FFT-based Technique for Translation,Rotation,and Scale-invariant Image Registration[J].IEEE Transactions on Image Process,1996,3(8):1266-1270.
[166]Keller Y,Averbuch A,Israeli M.Pseudo-Polar Based Estimation of Large Translations,Rotations,and Scalings in Images[J].IEEE Transactions on Image Processing,2005,14(1):12-22
[167]LIU Han-zhou,GUO Bao-long,FENG Zong-zhe.Pseudo-log-polar Fourier Transform for Image Registration[J].IEEE Signal Processing Letters,2006,13(1):17-20
[168]Popescu V,Lastra A,Eyles J,et al.The WarpEngine:An Architecture for the Post-Polygonal Age[C].Computer Graphics(SIGGRAPH,2000),2000:433-442.
[169]Shade J,Gortler S,He L W,et al.Layered Depth Images[C].Computer Graphics (SIGGRAPH,98),1998:231-242
[170]Kuglin C D,Hines D C.The Phase Correlation Image Alignment Method[C].Proceedings of IEEE Conference on Cybernetics and Society,New York,September,1975:163-165
[171]Lertrattanapanich S.Image Registration for Video Mosaic[D].Master's Thesis,The Pennsylvania State University,1999
[172]李勤,俞信.适合于生物图像的图像融合算法研究[J].光学学报.2000,20(4):494-500