基于视频标记的四足动物运动重建方法
|
摘要
文章针对四足动物的运动源数据获取困难的问题,引入简单易用的步态概念,提出一种基于视频标记的四足动物运动重建方法。从视频中标记原始步态信息,并对步态进行形式化描述,进而估算出当前步态的速度信息;从视频中标记原始骨架关键节点,对四足动物的骨架模型进行三维重建;基于步态参数和骨架结构,恢复四足动物的足尖运动轨迹;通过反向运动学方法求解四足动物的腿部运动信息,并近似模拟躯干、头、尾运动,最终重建全身运动。实验证明,该文方法可以快速有效地辅助用户重建视频中四足动物的运动数据,且其重建结果具有一定的视觉真实感。
To solve the difficulties of capturing the quadruped motion data,an easy-to-use concept of gait is introduced,and a novel method of quadruped motion reconstruction based on marks on video is presented.Firstly,the gait information is marked from a video clip,and the gait parameters with formal description are represented.The speed of the current motion is estimated from marked gait parameters.Secondly,the key nodes of skeleton structure are marked from the same video in order to build 3 Dskeleton model for the quadruped.Thirdly,based on gait parameters and skeleton structure,the motion trajectories of all four toes are reconstructed.Finally,the motions of each limb are calculated by using inverse kinematics,and with approximate simulations of the torso,head and tail motions of the quadruped,the motions of the whole body are reconstructed from the given video.The experimental results show that the presented method provides a simple and effective way for assisting users to reconstruct quadruped motion from video with visually acceptable reality.
To solve the difficulties of capturing the quadruped motion data,an easy-to-use concept of gait is introduced,and a novel method of quadruped motion reconstruction based on marks on video is presented.Firstly,the gait information is marked from a video clip,and the gait parameters with formal description are represented.The speed of the current motion is estimated from marked gait parameters.Secondly,the key nodes of skeleton structure are marked from the same video in order to build 3 Dskeleton model for the quadruped.Thirdly,based on gait parameters and skeleton structure,the motion trajectories of all four toes are reconstructed.Finally,the motions of each limb are calculated by using inverse kinematics,and with approximate simulations of the torso,head and tail motions of the quadruped,the motions of the whole body are reconstructed from the given video.The experimental results show that the presented method provides a simple and effective way for assisting users to reconstruct quadruped motion from video with visually acceptable reality.
引文
[1]谢文军,陆劲挺,刘晓平.语义中间骨架驱动的自动异构运动重定向[J].计算机辅助设计与图形学学报,2016,28(5):750-762.
[2] MCLAUGHLIN T,CUTLER L,COLEMAN D.Character rigging,deformations,and simulations in film and game production[C]//ACM SIGGRAPH 2011 Courses.[S.l.:s.n.],2011:1-18.
[3] SKRBA L,REVERET L,HE′TROY F,et al.Animating quadrupeds:methods and applications[J].Computer Graphics Forum,2009,28(6):1541-1560.
[4] WIDGERY R.Horse locomotion-horse movement&motion capture data[EB/OL].[2016-03-01].http://www.kineticimpulsecom//horse-motion-capture-data/index.html.
[5] WILHELMS J,GELDER A V.Combining vision and computer graphics for video motion capture[J].The Visual Computer,2003,19(6):360-376.
[6] HENNION B,VILLANOVA J,GUINOT J C,et al.A biomimetic approach to quadrupedal walking modelling[C]//2004.Proceedings World Automation Congress.[S.l.]:IEEE Xplore,2004:331-338.
[7] KOVAR L,GLEICHER M.Motion graphs[C]//International Conference on Computer Graphics and Interactive Techniques.[S.l.:s.n.],2002:473-482.
[8] SUNG M.Fast motion synthesis of massive number of quadruped animals[J].International Journal of Contents,2011,7(7):19-28.
[9] SUNG M.Fast motion synthesis of quadrupedal animals using a minimum amount of motion capture data[J].Etri Journal,2013,35(6):1029-1037.
[10]WAMPLER K,POPOVIC Z.Optimal gait and form for animal locomotion[J].ACM Transactions on Graphics,2009,28(3):341-352.
[11] HUANG T,HUANG Y,LIN W.Real-time horse gait synthesis[J].Computer Animation and Virtual Worlds,2013,24(2):87-95.
[12] COROS S,KARPATHY A,JONES B,et al.Locomotion skills for simulated quadrupeds[J].ACM Transactions on Graphics,2011,30(4):1-12.
[13] HILDEBRAND M.Symmetrical gaits of horses[J].Science,1965,150(3697):701-708.
[14] GIBSON D P,CAMPBELL N W,THOMAS B T.Quadruped gait analysis using sparse motion information[C]//International Conference on Image Processing.[S.l.:s.n.],2003:14-17.
[15] HANNUNA S L,CAMPBELL N W,GIBSON D P.Identifying quadruped gait in wildlife video[C]//IEEE International Conference on Image Processing.[S.l.:s.n.],2005:713-716.
[16] MAES L D,HERBIN M,HACKERT R,et al.Steady locomotion in dogs:temporal and associated spatial coordination patterns and the effect of speed[J].Journal of Experimental Biology,2008,211(1):138-149.
[17] DAI H,CAI B,SONG J,et al.Skeletal animation based on BVH motion data[C]//2nd International Conference on Information Engineering and Computer Science.[S.l.:s.n.],2010:1-4.
[18] BHATTI Z,SHAH A,SHAHIDI F.Procedural model of horse simulation[C]//ACM SIGGRAPH International Conference on Virtual-Reality Continuum and ITS Applications in Industry.[S.l.]:ACM,2013:139-146.
[2] MCLAUGHLIN T,CUTLER L,COLEMAN D.Character rigging,deformations,and simulations in film and game production[C]//ACM SIGGRAPH 2011 Courses.[S.l.:s.n.],2011:1-18.
[3] SKRBA L,REVERET L,HE′TROY F,et al.Animating quadrupeds:methods and applications[J].Computer Graphics Forum,2009,28(6):1541-1560.
[4] WIDGERY R.Horse locomotion-horse movement&motion capture data[EB/OL].[2016-03-01].http://www.kineticimpulsecom//horse-motion-capture-data/index.html.
[5] WILHELMS J,GELDER A V.Combining vision and computer graphics for video motion capture[J].The Visual Computer,2003,19(6):360-376.
[6] HENNION B,VILLANOVA J,GUINOT J C,et al.A biomimetic approach to quadrupedal walking modelling[C]//2004.Proceedings World Automation Congress.[S.l.]:IEEE Xplore,2004:331-338.
[7] KOVAR L,GLEICHER M.Motion graphs[C]//International Conference on Computer Graphics and Interactive Techniques.[S.l.:s.n.],2002:473-482.
[8] SUNG M.Fast motion synthesis of massive number of quadruped animals[J].International Journal of Contents,2011,7(7):19-28.
[9] SUNG M.Fast motion synthesis of quadrupedal animals using a minimum amount of motion capture data[J].Etri Journal,2013,35(6):1029-1037.
[10]WAMPLER K,POPOVIC Z.Optimal gait and form for animal locomotion[J].ACM Transactions on Graphics,2009,28(3):341-352.
[11] HUANG T,HUANG Y,LIN W.Real-time horse gait synthesis[J].Computer Animation and Virtual Worlds,2013,24(2):87-95.
[12] COROS S,KARPATHY A,JONES B,et al.Locomotion skills for simulated quadrupeds[J].ACM Transactions on Graphics,2011,30(4):1-12.
[13] HILDEBRAND M.Symmetrical gaits of horses[J].Science,1965,150(3697):701-708.
[14] GIBSON D P,CAMPBELL N W,THOMAS B T.Quadruped gait analysis using sparse motion information[C]//International Conference on Image Processing.[S.l.:s.n.],2003:14-17.
[15] HANNUNA S L,CAMPBELL N W,GIBSON D P.Identifying quadruped gait in wildlife video[C]//IEEE International Conference on Image Processing.[S.l.:s.n.],2005:713-716.
[16] MAES L D,HERBIN M,HACKERT R,et al.Steady locomotion in dogs:temporal and associated spatial coordination patterns and the effect of speed[J].Journal of Experimental Biology,2008,211(1):138-149.
[17] DAI H,CAI B,SONG J,et al.Skeletal animation based on BVH motion data[C]//2nd International Conference on Information Engineering and Computer Science.[S.l.:s.n.],2010:1-4.
[18] BHATTI Z,SHAH A,SHAHIDI F.Procedural model of horse simulation[C]//ACM SIGGRAPH International Conference on Virtual-Reality Continuum and ITS Applications in Industry.[S.l.]:ACM,2013:139-146.