体感游戏中玩家的肢体动作对空间认知的作用研究
|
摘要
本文的主要研究对象是体感游戏空间中玩家的肢体动作与空间认知的关系。空间是物质存在的形式之一,客观空间在人类诞生以前就已经存在,是物质和人类赖以生存的基础;思维空间和虚拟空间都出现在人类诞生以后,虚拟空间是人类文明发展到一定阶段的产物。我们平时之所以能够自由地进行我们的活动是基于平时对空间的认知,每天去上学、上班等活动都涉及到对周围环境的认知;空间认知包含空间特征感知、空间对象认知和空间格局认知三个层次,并且空间特征和空间对象是空间认知的两个基本单位。肢体动作泛指我们头部、上肢和下肢三部分的动作,我们人类从幼儿时期就开始通过肢体的动作去感知空间,婴儿通过抓取物体、触碰物体,在大脑中形成了各个物体之间的空间位置关系,通过头部的旋转来辨别方向;到了成年阶段以盲人这一特殊群体来看,盲人认知空间的主要来源是肢体的触碰,或者间接的“触摸”,也正是这种认知方式让盲人认知的空间要比我们常人来得真实。
接下来本文从生理学的角度出发研究了人类能够进行空间认知的生理学基础。全息图是指能够记录物体相位信息的图,相关研究表明量子理论中光子的纠缠态和人类大脑中的存储机制极为相似,所以人脑空间全息图就和全息图联系起来了,人脑全息图是指我们人脑中存在着能够存储我们空间认知信息的“全息图”,我们平时的活动都依赖于它。镜像神经元的理论把现实空间和体感游戏空间联系了起来,镜像神经元是它们共同的基础。
体感游戏是近几年发展起来的游戏新形式,最早的体感游戏出现在任天堂公司推出的Wii游戏平台,通过手持动作感应器进行游戏。体感游戏相对于传统游戏来说是革命性地,主要体现在它的输入方式上面,极大地调动了玩家的身体,既起到娱乐的效果又能锻炼身体。分析表明,玩家对PC平台上面的游戏的空间认知是通过平时的空间经验和对操作的熟练程度完成的,在Wii和XBOX平台上则是通过空间经验和肢体动作进行认知的,并且肢体动作占大部分比例。实验数据证明在体感环境下肢体动作能够帮助玩家更好地认知空间,并且对于玩家来说肢体动作对于距离的判断的作用要比对角度的判断大。
This paper studies on the relationship between users’body actions and spatial cognition in somatic games. Space is one of substance’s existing forms in objective space; objective space had already existed before human beings came into being, and is the base of objects and human beings. Thinking space and virtual space come into being after human beings appeared, and it’s the product of human civilization. Why we can do whatever we want to is due to the space we cognize every day, things like going to school, working are related to the familiar cognitive space we are living. Spatial cognition contains perception of spatial features, spatial object cognition and spatial pattern cognition, and spatial features and spatial objects are two basic units in the process of spatial cognition. Body movement contains head movement, up-body movement and down-body movement. Then I analyze the way how body actions help baby form their sense of space, baby forms the space information between objects through grasping and touching objects, and this is the early process human beings form our sense of space. It’s true that most of blind people’s space information is got through touching, and this is the reason why blind people can percept more real space.
Next, I research physiologic basis why we can carry out spatial cognition. As we all know, holograph can record object’s 3D information; Some relevant research has shown the similarity between quantum theory and memory mechanism in our brains, so brain space hologram and hologram are connected. Brain space hologram is the map which can storage space information and direct our everyday work. Mirror-neuron theory connects real space and somatic game space, and it’s the base of two spaces.
Somatic game is the new game form which developed in recent years. The first somatic game was created by Nintendo on the Wii platform, using motion sensor to match the actions in objective world and somatic game space. somatic game is revolutionary compared with traditional games, considering its controlling terminal, which mobilizes user’s body, and it brings fun together with healthy lifestyle. Next, I analyze use’s cognitive ways in PC, Wii and XBOX platforms, and it indicates that user’s cognitive way in PC games is got through spatial experience and grasping the controlling points in games, and the ways in Wii and XBOX games are gained through spatial experience and body actions, and most of information is gained through body movement. Experiment data has proved body movement can help users cognize space in somatic games, and body movement can help in larger extent in space distance than rotation.
接下来本文从生理学的角度出发研究了人类能够进行空间认知的生理学基础。全息图是指能够记录物体相位信息的图,相关研究表明量子理论中光子的纠缠态和人类大脑中的存储机制极为相似,所以人脑空间全息图就和全息图联系起来了,人脑全息图是指我们人脑中存在着能够存储我们空间认知信息的“全息图”,我们平时的活动都依赖于它。镜像神经元的理论把现实空间和体感游戏空间联系了起来,镜像神经元是它们共同的基础。
体感游戏是近几年发展起来的游戏新形式,最早的体感游戏出现在任天堂公司推出的Wii游戏平台,通过手持动作感应器进行游戏。体感游戏相对于传统游戏来说是革命性地,主要体现在它的输入方式上面,极大地调动了玩家的身体,既起到娱乐的效果又能锻炼身体。分析表明,玩家对PC平台上面的游戏的空间认知是通过平时的空间经验和对操作的熟练程度完成的,在Wii和XBOX平台上则是通过空间经验和肢体动作进行认知的,并且肢体动作占大部分比例。实验数据证明在体感环境下肢体动作能够帮助玩家更好地认知空间,并且对于玩家来说肢体动作对于距离的判断的作用要比对角度的判断大。
This paper studies on the relationship between users’body actions and spatial cognition in somatic games. Space is one of substance’s existing forms in objective space; objective space had already existed before human beings came into being, and is the base of objects and human beings. Thinking space and virtual space come into being after human beings appeared, and it’s the product of human civilization. Why we can do whatever we want to is due to the space we cognize every day, things like going to school, working are related to the familiar cognitive space we are living. Spatial cognition contains perception of spatial features, spatial object cognition and spatial pattern cognition, and spatial features and spatial objects are two basic units in the process of spatial cognition. Body movement contains head movement, up-body movement and down-body movement. Then I analyze the way how body actions help baby form their sense of space, baby forms the space information between objects through grasping and touching objects, and this is the early process human beings form our sense of space. It’s true that most of blind people’s space information is got through touching, and this is the reason why blind people can percept more real space.
Next, I research physiologic basis why we can carry out spatial cognition. As we all know, holograph can record object’s 3D information; Some relevant research has shown the similarity between quantum theory and memory mechanism in our brains, so brain space hologram and hologram are connected. Brain space hologram is the map which can storage space information and direct our everyday work. Mirror-neuron theory connects real space and somatic game space, and it’s the base of two spaces.
Somatic game is the new game form which developed in recent years. The first somatic game was created by Nintendo on the Wii platform, using motion sensor to match the actions in objective world and somatic game space. somatic game is revolutionary compared with traditional games, considering its controlling terminal, which mobilizes user’s body, and it brings fun together with healthy lifestyle. Next, I analyze use’s cognitive ways in PC, Wii and XBOX platforms, and it indicates that user’s cognitive way in PC games is got through spatial experience and grasping the controlling points in games, and the ways in Wii and XBOX games are gained through spatial experience and body actions, and most of information is gained through body movement. Experiment data has proved body movement can help users cognize space in somatic games, and body movement can help in larger extent in space distance than rotation.
引文
[1] Isaac C, MunW L. 3D Body Reconstruction for Immersive Interaction[J]. AMDO, 2002: 119-130.
[2] Yang K A, Young C P, Kwang S C. TOF Depth Camera Based 3D Gesture Interaction System[J]. IAIT, 2009(55): 11-17.
[3] David E, Martin R, Paul F. Towards an Advanced Framework for Whole Body Interaction[J]. Virtual and Mixed Reality, 2009: 32-40.
[4]皮亚杰.发生认知论原理[M].王宪铀,译.北京:商务印书馆,1985:5-55.
[5]丁峻,陈巍,袁逖飞.阐明心理理论机制的新途径—来自镜像神经元研究的证据[J].南京师大学报,2009(01):99-106.
[6] Jeong D C, Byung T J, Chi J H. Collaborative Interactions on 3D Display for Multi-user Game Environments[J]. APCHI 2004, LNCS 3101, 2004: 81-90.
[7] Jean C L, Lionel B, Jean M P. Afforded Actions as a Behavioral Assessment of Physical Presence in Virtual Environments[J]. Virtual Reality (2009) 13, 2008(13):141-151.
[8] Hang Y, Xu G, Zhu Y. Extraction of Spatial-Temporal Features for Vision-Based Gesture Recognition[J]. Comput. Sci. & Technol, 2000(15): 1-9.
[9] Christian B, Heinrich M. Remote Vision-Based Multi-type Gesture Interaction[J]. GW(2003), 2004: 198-209.
[10]中国大百科全书编辑委员会编著.中国大百科全书?美术I.第一版[M].北京:中国大百科全书出版社,1990:80.
[11]边馥苓,王金鑫.现实空间、思维空间、虚拟空间—关于人类生存空间的哲学思考[J].武汉大学学报,2003(28):4-7.
[12]鲁学军,秦承志,张洪岩,程维明.空间认知模式及其应用[J].遥感学报,2005(09):277-284.
[13]袁建锋.基于空间认知的虚拟地形环境构建研究[J].测绘与空间信息,2008(31):114-116.
[14]史忠植.认知科学[M].合肥:中国科学技术大学出版社,2008:184-194.
[15]李长军.长时记忆形成的全息特性及空间信息的提取和保持.大连理工大学硕士学位论文[D],2009:11-19.
[16]皮亚杰.儿童心理学[M].吴福元,译.北京:商务印书馆,1981:5-12.
[17] Anja H, Christian Z, Heidi S. Adaptive Motion Pattern Recognition: Implementing Playful Learning through Embodied Interaction. DigitalHuman Modeling[J], 2009: 105-114.
[18] António N, Carlos D. Comparing Gestures and Traditional Interaction Modalities on Large Displays[J]. INTERACT(2009), 2009(02): 58-61.
[19] Mi J K. The Impact of Tangible User Interfaces on Spatial Cognition During Collaborative Design[J]. Design Studies, 2008(29): 222-253.
[20] Andrew U F, Steffen B, Martin R. Spatial and Cognitive Simulation with Multi-agent Systems[J]. COSIT 2001, LNCS 2205, 2001: 124-139.
[21]丁峻,陈巍,袁逖飞.镜像神经元研究概况述评[J].生命科学,2007(19):1-4.
[22] Barry A P, Brian D F, Kellogg S B. A Two Visual Systems Approach to Understanding Voice and Gestural Interaction[J]. Virtual Reality (2005), 2005(08): 231-241.
[23] Bernhard R. Spatial Perception and Cognition in Virtual Environments[J]. iat805_ResearchColloqTalk, 2010: 1-5.
[24] Mitja K, Bojana B. Design and Evaluation of User’s Physical Experience in an Ambient Interactive Storybook and Full Body Interaction Games[J]. Multimed Tools Appl, 2010(10): 1-27.
[25] Kaveri S P G. Effect of Video Game Practice on Spatial Skills in Girls and Boys[J]. Journal Of Applied Development Psychology, 1994(15): 13-32.
[26] Zhi Q L, Henry B L D. Effects of Perspective Elevation and Environmental Geometry on Representation of a Virtual Room Space[J]. Virtual Reality (2009), 2009(13): 27-35.
[27]百度百科.肢体定义. http://baike.baidu.com/view/641362.htm
[28]贺拉斯.诗学[M].罗念生,译.北京:人民文学出版社,1962:65-109.
[29]张月惠.动作—表演艺术的基础[J].贵州大学学报,2006(20): 86.
[30] Marijn E S, Matthijs L N, Albert P. What is the Link Between Language and Spatial Images? Behavioral and Neural Findings in Blind and Sighted Individuals[J]. Acta Psychologica, 2009(132): 145-156.
[31] Zaira C, Tomaso V, Cesare C, et al. Imagery and Spatial Processes in Blindness and Visual Impairment[J]. Neuroscience and Biobehavioral Reviews, 2008(32): 1346-1460.
[32] Jack M L, Roberta L K, Reginald G. Nonvisual Navigation by Blind and Sighted: Assessment of Path Integration Ability[J]. lournsl of Experimental Psychology: General, 1993(122): 73-91.
[33] Jaime S, Mauricio S. Metro Navigation for the Blind[J]. Computers & Education, 2010(55): 970-981.
[34] Michael E, Ann N, Schreiner M E. Helping Users Think in Three Dimensions: Steps Toward Incorporating Spatial Cognition in User Modelling[J]. Q1997ACM, 1997(97): 113-120.
[35]李喜先. 21世纪100个交叉科学难题[M].北京:科学出版社,2005:518-527.
[36]陈巍,丁俊.镜像神经元:从个体认知到社会行为[J].华东师范大学学报,2009(27):51-55.
[37]李波.健身单车体感游戏设计与实现[D].湖南大学硕士学位论文,2010: 11-18.
[38] Giuseppe R. Is Presence a Technology Issue? Some Insights From Cognitive Sciences[J]. Virtual Reality (2009), 2009(13): 159-169.
[39] Carlos D, Ant′onio N. Gesture Interaction in Cooperation Scenarios[J]. CRIWG 2009, LNCS 5784, 2009: 64-72.
[40] Marco P, Nadia B B, Betsy V D. Immersion in Movement-Based Interaction[J]. INTETAIN 2009, LNICST 9, 2009(09): 169-180.
[41] Ronan B, Daniel R. Integrated Analytic and Linearized Inverse Kinematics for Precise Full Body Interactions[J]. MIG 2009, LNCS 5884, 2009: 231-242.
[42] Sun.教育游戏研究网. (2008-09) [2010-06-27]. http://www.eegame.cn/upload/2009_02/09020515345304.pdf
[43] Mitja K, Bojana B. Evaluation of User’s Physical Experience in Full Body Interactive Games[J]. HAID 2009, LNCS 5763, 2009: 145-154.
[44] Gerald F, Markus H, Heinrich H B. The Influence of the Horizon Height on Spatial Perception in VR[J]. Max-planck-gesellschaft, 2004: 1.
[2] Yang K A, Young C P, Kwang S C. TOF Depth Camera Based 3D Gesture Interaction System[J]. IAIT, 2009(55): 11-17.
[3] David E, Martin R, Paul F. Towards an Advanced Framework for Whole Body Interaction[J]. Virtual and Mixed Reality, 2009: 32-40.
[4]皮亚杰.发生认知论原理[M].王宪铀,译.北京:商务印书馆,1985:5-55.
[5]丁峻,陈巍,袁逖飞.阐明心理理论机制的新途径—来自镜像神经元研究的证据[J].南京师大学报,2009(01):99-106.
[6] Jeong D C, Byung T J, Chi J H. Collaborative Interactions on 3D Display for Multi-user Game Environments[J]. APCHI 2004, LNCS 3101, 2004: 81-90.
[7] Jean C L, Lionel B, Jean M P. Afforded Actions as a Behavioral Assessment of Physical Presence in Virtual Environments[J]. Virtual Reality (2009) 13, 2008(13):141-151.
[8] Hang Y, Xu G, Zhu Y. Extraction of Spatial-Temporal Features for Vision-Based Gesture Recognition[J]. Comput. Sci. & Technol, 2000(15): 1-9.
[9] Christian B, Heinrich M. Remote Vision-Based Multi-type Gesture Interaction[J]. GW(2003), 2004: 198-209.
[10]中国大百科全书编辑委员会编著.中国大百科全书?美术I.第一版[M].北京:中国大百科全书出版社,1990:80.
[11]边馥苓,王金鑫.现实空间、思维空间、虚拟空间—关于人类生存空间的哲学思考[J].武汉大学学报,2003(28):4-7.
[12]鲁学军,秦承志,张洪岩,程维明.空间认知模式及其应用[J].遥感学报,2005(09):277-284.
[13]袁建锋.基于空间认知的虚拟地形环境构建研究[J].测绘与空间信息,2008(31):114-116.
[14]史忠植.认知科学[M].合肥:中国科学技术大学出版社,2008:184-194.
[15]李长军.长时记忆形成的全息特性及空间信息的提取和保持.大连理工大学硕士学位论文[D],2009:11-19.
[16]皮亚杰.儿童心理学[M].吴福元,译.北京:商务印书馆,1981:5-12.
[17] Anja H, Christian Z, Heidi S. Adaptive Motion Pattern Recognition: Implementing Playful Learning through Embodied Interaction. DigitalHuman Modeling[J], 2009: 105-114.
[18] António N, Carlos D. Comparing Gestures and Traditional Interaction Modalities on Large Displays[J]. INTERACT(2009), 2009(02): 58-61.
[19] Mi J K. The Impact of Tangible User Interfaces on Spatial Cognition During Collaborative Design[J]. Design Studies, 2008(29): 222-253.
[20] Andrew U F, Steffen B, Martin R. Spatial and Cognitive Simulation with Multi-agent Systems[J]. COSIT 2001, LNCS 2205, 2001: 124-139.
[21]丁峻,陈巍,袁逖飞.镜像神经元研究概况述评[J].生命科学,2007(19):1-4.
[22] Barry A P, Brian D F, Kellogg S B. A Two Visual Systems Approach to Understanding Voice and Gestural Interaction[J]. Virtual Reality (2005), 2005(08): 231-241.
[23] Bernhard R. Spatial Perception and Cognition in Virtual Environments[J]. iat805_ResearchColloqTalk, 2010: 1-5.
[24] Mitja K, Bojana B. Design and Evaluation of User’s Physical Experience in an Ambient Interactive Storybook and Full Body Interaction Games[J]. Multimed Tools Appl, 2010(10): 1-27.
[25] Kaveri S P G. Effect of Video Game Practice on Spatial Skills in Girls and Boys[J]. Journal Of Applied Development Psychology, 1994(15): 13-32.
[26] Zhi Q L, Henry B L D. Effects of Perspective Elevation and Environmental Geometry on Representation of a Virtual Room Space[J]. Virtual Reality (2009), 2009(13): 27-35.
[27]百度百科.肢体定义. http://baike.baidu.com/view/641362.htm
[28]贺拉斯.诗学[M].罗念生,译.北京:人民文学出版社,1962:65-109.
[29]张月惠.动作—表演艺术的基础[J].贵州大学学报,2006(20): 86.
[30] Marijn E S, Matthijs L N, Albert P. What is the Link Between Language and Spatial Images? Behavioral and Neural Findings in Blind and Sighted Individuals[J]. Acta Psychologica, 2009(132): 145-156.
[31] Zaira C, Tomaso V, Cesare C, et al. Imagery and Spatial Processes in Blindness and Visual Impairment[J]. Neuroscience and Biobehavioral Reviews, 2008(32): 1346-1460.
[32] Jack M L, Roberta L K, Reginald G. Nonvisual Navigation by Blind and Sighted: Assessment of Path Integration Ability[J]. lournsl of Experimental Psychology: General, 1993(122): 73-91.
[33] Jaime S, Mauricio S. Metro Navigation for the Blind[J]. Computers & Education, 2010(55): 970-981.
[34] Michael E, Ann N, Schreiner M E. Helping Users Think in Three Dimensions: Steps Toward Incorporating Spatial Cognition in User Modelling[J]. Q1997ACM, 1997(97): 113-120.
[35]李喜先. 21世纪100个交叉科学难题[M].北京:科学出版社,2005:518-527.
[36]陈巍,丁俊.镜像神经元:从个体认知到社会行为[J].华东师范大学学报,2009(27):51-55.
[37]李波.健身单车体感游戏设计与实现[D].湖南大学硕士学位论文,2010: 11-18.
[38] Giuseppe R. Is Presence a Technology Issue? Some Insights From Cognitive Sciences[J]. Virtual Reality (2009), 2009(13): 159-169.
[39] Carlos D, Ant′onio N. Gesture Interaction in Cooperation Scenarios[J]. CRIWG 2009, LNCS 5784, 2009: 64-72.
[40] Marco P, Nadia B B, Betsy V D. Immersion in Movement-Based Interaction[J]. INTETAIN 2009, LNICST 9, 2009(09): 169-180.
[41] Ronan B, Daniel R. Integrated Analytic and Linearized Inverse Kinematics for Precise Full Body Interactions[J]. MIG 2009, LNCS 5884, 2009: 231-242.
[42] Sun.教育游戏研究网. (2008-09) [2010-06-27]. http://www.eegame.cn/upload/2009_02/09020515345304.pdf
[43] Mitja K, Bojana B. Evaluation of User’s Physical Experience in Full Body Interactive Games[J]. HAID 2009, LNCS 5763, 2009: 145-154.
[44] Gerald F, Markus H, Heinrich H B. The Influence of the Horizon Height on Spatial Perception in VR[J]. Max-planck-gesellschaft, 2004: 1.