摘要
随着虚拟现实的发展,自然和谐的人机交互日益成为一个重要的研究领域。在基于虚拟现实的训练、教育、娱乐、建筑设计等领域,人机交互有着非常重要的作用。但是,由于计算机生成的虚拟环境无法精确地模拟真实物理世界中的许多规则和约束,因此实现自然、和谐的人机交互非常困难。
虚拟手交互技术是人机交互研究领域的研究热点。虚拟抓取是用户与虚拟环境中的物体进行交互的一种自然直观的方式。本文围绕如何在虚拟抓取过程中增强用户体验和减少用户负担展开研究。
本文通过对人手解剖结构以及运动学特征的分析,首先提出了一个包含皮肤层、运动层、碰撞检测层、力觉层的4层灵巧虚拟手模型。该模型在保证交互实时性的前提下,提高了虚拟交互的真实感。其次,在对现实世界中的物体进行形状抽象的基础上,提出了基于几何条件的抓取准则,既提高了抓取判别的速度,又减少了误抓现象的发生。此外,在抓取过程中利用虚拟抓取有限状态机进行控制,避免了虚拟手手指嵌入物体。最后,通过对人手抓取轨迹规律的分析,提出了一种自动抓取方法,可以有效地减少用户交互的负担。实验结果表明了本文算法的有效性。
With the development of virtual reality, natural and harmonious human-computer interaction has become an important field of study. HCI plays a very important role in virtual reality-based simulation, training, education, entertainment, architectural design and other fields. However, the virtual environment generated by the computer can not accurately simulate the real physical world in many of the rules and constraints, it is very difficult to achieve a natural and harmonious human-computer interaction.
Virtual hand is one of the hottest topics in human-computer interaction. Virtual grasp is a natural intuitive way for the user to interact with the virtual objects in virtual environment. We present methods on how to enhance the user experience and reduce the burden on the user.
We propose a 4-layer flexible virtual hand model, which consist of skin layer, kinematics layer, collision detection layer and haptic layer, for virtual hand interaction. The model can not only enhance the realism of the virtual interaction, but also ensure the premise of real-time. Based on the shape abstraction of objects, geometry based grasping rules are proposed. It can reduce the incidence of false grasp, as well as increase the speed of grasp identifying. We can control the grasping states by using virtual grasping finite state machine to prevent the interpenetration of the virtual hand and objects. In order to alleviate the users' burden, an automatic grasping method is proposed. The experiment results show the validity of our algorithm.
引文
[1]朱名铨,张树生等,虚拟制造系统与实现,西安,西北工业大学出版社,2001.11-40.
[2]刘威,基于虚拟现实的力觉临场遥感操作研究[博士学位论文],南京,东南大学,2006,4-12.
[3]张凤军,纪连恩等译,三维用户界面:理论与实践,北京,电子工业出版社,2006,1-15.
[4]E.Suthefiand,"Head mounted three dimensional display",In Proceedings of the Fall Joint Computer Conference,1968,33,757-764.
[5]Andre Leblanc,Prem Kalra,Nadia Magnenat Thalmann and Daniel Thalmann,"Sculpting with the 'ball and mouse' metaphor",In Proceedings of Graphics Interface '91,1991,152-159.
[6]Tinsley A.Galyean and John F.Hughes,"Sculpting:an interactive volumetric modeling technique",In Proceedings of SIGGRAPH'91,July 1991,267-274.
[7]Tamotsu Murakami and Naomasa Nakakima,"Direct and intuitive input device for 3-D shape deformation",In Proceedings of CHI'94,April 1994,465-470.
[8]Chris Shaw and Mark Green."Two-handed polygonal surface design",In Proceedings of the 7~(th) annual ACM Symposium on User Interface Software and Technology,1994,205-212.
[9]Enrico Gobbetti,Jean-Francis Balaguer and Daniel Thalmann,"VB2:An architecture for interaction in synthetic worlds",In Proceedings of the ACM SIGGRAPH Symposium on User Interface Software and Technology(UIST'93),1993,167-178.
[10]Eric A.Bier,"Snap-dragging in three dimensions",In Proceedings of the 1990Symposium on Interactive 3D Graphics,ACM SIGGRAPH,Match 1990,193-203.
[11]Stephanie Houde,"Iterative design of an interface for easy 3-D direct manipulation",In Proceedings of CHI'92,ACM SIGCHI,May 1992,135-142.
[12]T.Yoshimura,Y.Nakamura and M.Sugiura,"3D direct manipulation interface:Development of the zashiki-warashi system",Computers & Graphics,1994,18(2),201-207.
[13] Michael Chen, S. Joy Mountford and Abigail Sellen, "A study in interactive 3-D rotation using 2-D control devices", In Proceedings of SIGGRAPH'88, ACM SIGGRAPH,August 1988, 121-129.
[14] Colin Ware, "Using hand position for virtual object placement", The Visual Computer, 1990, 6: 245-253.
[15] Colin Ware and Steven Osborne, "Exploration and virtual camera control in virtual three dimensional environments", In Proceedings of 1990 Symposium on Interactive 3D Graphics, 1990,175-183.
[16] E. Gobbetti and J. F. Balaguer, "An integrated environment to visually construct 3D animations", In Proceedings of the 22~(nd) annual ACM conference on Computer graphics(SIGGRAPH'95), August 1995, 395-398.
[17] Robert C. Zeleznik, Kenneth P. Herndon, Daniel C. Robbins, Nate Huang, Tom Meyer, Noah Parker and John F. Hughes, "An interactive 3D tookit for constructing 3D widgets", In Proceedings of SIGGRAPH'93, ACM SIGGRAPH,1993,81-84.
[18] Ben Shneiderman, "Direct manipulation: A step beyond programming languages", IEEE Computer, August 1983, 57-62.
[19] Edwin L. Hutchins, James D. Hollan and Donald A. Norman, "Direct manipulation interfaces", In D. A. Norman and S. Draper, editors, User-Centered System Design, Lawrence Erlbaum Associates, 1986, 87-124.
[20] Eric A. Bier, "Skitters and jacks: interactive 3D positioning tools", In Proceedings of the 1986 Workshop on Interactive 3D Graphics, October 1986,183-196.
[21] Gregory M. Nielson and Dan R. Olsen, "Direct manipulation techniques for 3D objects using 2D locator devices", In 1986 Symposium on Interactive 3D Graphics, October 1986, 175-182.
[22] Dan Venolia, "Facile 3D direct manipulation", In Proceedings of INTERCHI'93,April 1993,31-36.
[23] Chris Hand, "A survey of 3D Interaction Techniques", Computer Graphics Forum, 1997, 16(5), 269-281.
[24] Christer Carlsson and Olof Hagsand, "DIVE: a multi-user virtual reality system",In Proceedings of Virtual Reality Annual International Symposium'93, 1993,394-400.
[25]Jiandong Liang and Mark Green,"JDCAD:A highly interactive 3D modeling system",Computers & Graphics,1994,18(4),499-506.
[26]Mark Mine,"Working in a virtual world:Interaction techniques used in the chapel hill immersive modeling program",Technical Report TR 96-029,Department of Computer Science,University of North Carolina,Chapel Hill,North Carolina,USA,1996.
[27]Richard A.Bolt,"'put-that-there':Voice and gesture at the graphics interface",In Proceedings of SIGGRAPH' 80,July 1980,262-270.
[28]Christopher Schmandt,"Spatial input/output correspondence in a stereoscopic computer graphics work station",Computer Graphics,July 1983,17(3),253-261.
[29]Ken Hinckley,Randy Pausch,John C.Goble and Neal F.Kassell,"Passive real-world interface props for neurosurgical visualization",In Proceedings of the SIGCHI conference on Human factors in computing systems,April 1994,452-458.
[30]Emanuel Sachs,Andrew Roberts and David Stoops,"3-Draw:A tool for designing 3D shapes",IEEE Computer Graphics and Applications,November 1991,18-26.
[31]Margaret Minsky,Ming Ouh-Young,Oliver Steele,Frederick P.Brooks and Max Behensky,"Feeling and seeing:Issues in force display",In Proceedings of SIGGRAPH'90,1990,235-243.
[32]李琪,白英彩,曾芬芳,一个虚拟手原型的实现,上海交通大学学报,1999,33(11),1377-1380.
[33]Doug A.Bowman,Ernst Kruijff,Joseph J.Laviola,Jr and Ivan Poupyrev,"An Introduction to 3-D User Interface Design",Presence,2001,10(1),96-108.
[34]Poupyrev.I,Billinghurst.M,Weghorst.S,and Ichikawa.T,"The Go-Go Interaction Technique:Non-linear Mapping for Direct Manipulation in VR",In Proceedings of the 9~(th) annual ACM Symposium on User Interface Software and Technology,1996,79-80.
[35]Stoakley.R,Conway.M,and Pausch.R,"Vritual Reality on a WIM:Interactive Worlds in Miniature",In Proceedings of the SIGCHI conference on Human factors in computing systems,1995,265-272.
[36]Huagen Wan,Yang Luo,Shuming Gao and Qunsheng Peng,"Realistic Virtual Hand Modeling with Applications for Virtual Grasping", In Proceedings of the 2004 ACM SIGGRAPH International Conference on Virtual Reality Continuum and its applications in industry, June 2004, 81-87.
[37] H. Iwata, "Artificial Reality with Force-Feedback: Development of Desktop Virtual Space with Compact Master Manipulator", Computer Graphics, 1990,24,165-170.
[38] M. Bergamasco, P. Degl'Innocenti, and D. Bucciarelli, "A Realistic Approach for Grasping and Moving Virtual Objects", In Proceedings of the IEEE International Conference on Intelligent Robots and Systems, 1994, 717-724.
[39] K. Hirota and M. Hirose. "Dexterous Object Manipulation Based on Collision Response", IEEE Virtual Reality, 2003.
[40] G. Zachmann and A. Rettig, "Natural and Robust Interaction in Virtual Assembly Simulation", In Eighth ISPE International Conference on Concurrent Engineering: Research and Application, 2001.
[41] R. Boulic, S, Rezzonico and D. Thalmann, "Multi-Finger Manipulation of Virtual Objects", ACM Symposium on Virtual Reality Software and Technology,1996.
[42] Thomas Ullmann and Joerg Sauer, "Intuitive Virtual Grasping for non-Haptic Environments", In Proceedings of the Eighth Pacific Conference on Computer Graphics and Applications, October 2000, 373-380.
[43] Christoph W. Borst and Arun P. Indugula, "Realistic Virtual Grasping", IEEE Virtual Reality, 2005, 9198.
[44] E. Kokkevis, D.Metaxas, and N. I. Badler, "User-Controlled Physics-Based Animation for Articulated Figures", Computer Animation, 1996.
[45] W. Westenhofer and J. Hahn, "Using Kinematic Clones to Control the Dynamics Simulation of Articulated Figures", Computer Graphics International, 1996.
[46] Andrew T. Miller, Steffen Knoop, Henrik I. Christensen and Peter K. Allen,"Automatic Grasp Planning Using Shape Primitives", In Proceedings of IEEE International Conference on Robotics and Automation,. 2003, 1824-1829.
[47] 肖伟,虚拟环境下启发式抓取算法研究[学士学位论文],杭州,浙江大学,2007, 19-24.
[48] Zhenhua Zhu, Shuming Gao, Huagen Wan and WenHen Yang,"Trajectory-Based Grasp Interaction for Virtual Environments", In Proceedings of Computer Graphics Interactional 2006,2006,300-311.
[49]Huagen Wan,Feifei Chen and Xiaoxia Han,"A 4-Layer Flexible Virtual Hand Model for Haptic Interaction",In 2009 IEEE International Conference on Virtual Environments,Human-Computer Interfaces and Measurement Systems,May 2009.
[50]S.Gottschalk,PM.C.Lin,and D.Manocha,"OBBTree:a hierarchical structure for rapid interference detection",In Proceedings of SIGGRAPH'96,1996,171-180.
[51]Fifth Dimension Technologies.http://www.5dt.com/products/pdataglove5u.html.
[52]Fakespace Pinch~(TM) Gloves.http://www.inition.co.uk/inition/product.php.
[53]CyberGrasp~(TM) Exoskeleton.http://www.immersion.corn/3d/products/index.html.
[54]原魁,杜清秀,CAS-GLOVE数据手套使用说明书,中国科学院自动化研究所高技术创新中心,2006,27-33.
[55]George EIKoura,and Karan Singh,"Handrix:Animating the Human Hand",In Proceedings of Eurographics Symposium on Computer Animation,2003,110-119.
[56]D.G.Kamper,E.G.Cruz and M.P.Siegel,"Stereotypical Fingertip Trajectories During Grasp",Journal of Neurophysiology.September 2003,90:3702-3710.
[57]M.R.Cutkosky and P.K.Wright,"Modeling manufacturing grips and correlation with the design of robotic hands",In Proceedings of the 1986 IEEE international Conference on Robotics and Automation,1986,1533-1539.
