Unsupervised skeleton extraction and motion capture from 3D deformable matching

详细信息    查看全文

• 作者：Quanshi Zhang^a ; ^{zqs1022@csis.u-tokyo.ac.jp}Author Vitae ; Xuan Song^a ; ^{songxuan@csis.u-tokyo.ac.jp}Author Vitae ; Xiaowei Shao^aAuthor Vitae ; Ryosuke Shibasaki^aAuthor Vitae ; Huijing Zhao^bAuthor Vitae
• 关键词：Skeleton extraction ; 3D point cloud sequence
• 刊名：Neurocomputing
• 出版年：2013
• 出版时间：16 January, 2013
• 年：2013
• 卷：100
• 期：Complete
• 页码：170-182
• 全文大小：6276 K

文摘

This paper presents a novel method to extract skeletons of complex articulated objects from 3D point cloud sequences collected by the Kinect. Our approach is more robust than the traditional video-based and stereo-based approaches, as the Kinect directly provides 3D information without any markers, 2D-to-3D-transition assumptions, and feature point extraction. We track all the raw 3D points on the object, and utilize the point trajectories to determine the object skeleton. The point tracking is achieved by the 3D non-rigid matching based on the Markov Random Field (MRF) Deformation Model. To reduce the large computational cost of the non-rigid matching, a coarse-to-fine procedure is proposed. To the best of our knowledge, this is the first to extract skeletons of highly deformable objects from 3D point cloud sequences by point tracking. Experiments prove our method's good performance, and the extracted skeletons are successfully applied to the motion capture.