Learning human shape model from multiple databases with correspondence considering kinematic consensus
详细信息    查看全文
  • 作者：Yao Yu (1)
    Yu Zhou (1)
    Sidan Du (1)
    Yuan Jie (1)
    Ziqiang Wang (1)
    Zhengyu Cai (1)

    1. School of Electronic Science and Engineering     ; Nanjing University ; Nanjing ; Jiangsu ; 210046 ; China
  • 关键词：Deformations ; Morphing ; Non ; rigid registration ; Motion capture and synthesis ; Correspondence
  • 刊名：The Visual Computer
  • 出版年：2015
  • 出版时间：January 2015
  • 年：2015
  • 卷：31
  • 期：1
  • 页码：19-33
  • 全文大小：6,168 KB
  • 参考文献：1. Aiger, D., Mitra, N., Cohen-Or, D.: 4-points congruent sets for robust pairwise surface registration. In: ACM Transactions on Graphics (TOG), vol. 27, p. 85. ACM, New York (2008)
    2. Allen, B., Curless, B., Popovi膰, Z.: The space of human body shapes: reconstruction and parameterization from range scans. In: ACM Transactions on Graphics (TOG), vol. 22, pp. 587鈥?94. ACM, New York (2003)
    3. Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J., Davis, J.: Scape: shape completion and animation of people. In: ACM Transactions on Graphics (TOG), vol. 24, pp. 408鈥?16. ACM, New York (2005)
    4. Anguelov, D., Srinivasan, P., Pang, H., Koller, D., Thrun, S., Davis, J.: The correlated correspondence algorithm for unsupervised registration of nonrigid surfaces. Adv. Neural Inf. Process. Syst. 17, 33鈥?0 (2005)
    5. Ben Azouz, Z., Shu, C., Mantel, A.: Automatic locating of anthropometric landmarks on 3D human models. (2006)
    6. Chang, W., Zwicker, M.: Automatic registration for articulated shapes. In: Computer Graphics Forum, vol. 27, pp. 1459鈥?468. Wiley Online Library, New York (2008)
    7. Fischler, M., Bolles, R.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381鈥?95 (1981) CrossRef
    8. Gelfand, N., Mitra, N., Guibas, L., Pottmann, H.: Robust global registration. In: Proceedings of the Third Eurographics Symposium on Geometry Processing, pp. 197鈥?06. (2005)
    9. Hasler, N., Stoll, C., Sunkel, M., Rosenhahn, B., Seidel, H.P.: A statistical model of human pose and body shape. In: Dutr鈥檈, P., Stamminger, M. (eds.) Computer Graphics Forum (Proceedings of Eurographics 2008), vol. 2. Munich, Germany (2009)
    10. Huang, Q., Adams, B., Wicke, M., Guibas, L.: Non-rigid registration under isometric deformations. In: Computer Graphics Forum, vol. 27, pp. 1449鈥?457. Wiley Online Library, New York (2008)
    11. Irani, S., Raghavan, P.: Combinatorial and experimental results for randomized point matching algorithms. Comput. Geom. 12(1鈥?), 17鈥?1 (1999) CrossRef
    12. James, D., Twigg, C.: Skinning mesh animations. In: ACM Transactions on Graphics (TOG), vol. 24, pp. 399鈥?07. ACM, New York (2005)
    13. Jolliffe, I.: Principal Component Analysis. Wiley Online Library, New York (2005)
    14. Kalogerakis, E., Hertzmann, A., Singh, K.: Learning 3D mesh segmentation and labeling. ACM Trans. Graph. 29(4), 102 (2010)
    15. Kraevoy, V., Sheffer, A.: Cross-parameterization and compatible remeshing of 3d models. In: ACM Transactions on Graphics (TOG), vol. 23, pp. 861鈥?69. ACM, New York (2004)
    16. Kry, P., James, D., Pai, D.: Eigenskin: real time large deformation character skinning in hardware. In: Symposium on Computer Animation: Proceedings of the 2002 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, vol. 21, pp. 153鈥?59 (2002)
    17. Lewis, J., Cordner, M., Fong, N.: Pose space deformation: an unified approach to shape interpolation and skeleton-driven deformation. In: Proceedings of the 27th Annual Conference on Computer Graphics And Interactive Techniques, pp. 165鈥?72. ACM Press/Addison-Wesley Publishing Co., New York (2000)
    18. Li, H., Sumner, R.W., Pauly, M.: Global correspondence optimization for non-rigid registration of depth scans. In: Computer Graphics Forum, vol. 27, pp. 1421鈥?430. Wiley Online Library, New York (2008)
    19. Lipman, Y., Sorkine, O., Cohen-Or, D., Levin, D., Rossi, C., Seidel, H.: Differential coordinates for interactive mesh editing. In: Shape Modeling Applications, 2004. Proceedings, pp. 181鈥?90. IEEE, New York (2004)
    20. Pekelny, Y., Gotsman, C.: Articulated object reconstruction and markerless motion capture from depth video. In: Computer Graphics Forum, vol. 27, pp. 399鈥?08. Wiley Online Library, New York (2008)
    21. Rusinkiewicz, S., Levoy, M.: Efficient variants of the icp algorithm. In: Third International Conference on 3-D Digital Imaging and Modeling, 2001. Proceedings, pp. 145鈥?52. IEEE, New York (2001)
    22. Shalom, S., Shapira, L., Shamir, A., Cohen-Or, D.: Part analogies in sets of objects. In: Eurographics Workshop on 3D Object Retrieval. (2008)
    23. Straka, M., Hauswiesner, S., Ruther, M., Bischof, H.: Rapid skin: estimating the 3D human pose and shape in real-time. In: 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission (3DIMPVT), pp. 41鈥?8. IEEE, New York (2012)
    24. Sumner, R., Popovi膰, J.: Deformation transfer for triangle meshes. In: ACM Transactions on Graphics (TOG), vol. 23, pp. 399鈥?05. ACM, New York (2004)
    25. Xu, K., Li, H., Zhang, H., Cohen-Or, D., Xiong, Y., Cheng, Z.: Style-content separation by anisotropic part scales. In: ACM Transactions on Graphics (TOG), vol. 29, p. 184. ACM, New York (2010)
    26. Ye, M., Wang, X., Yang, R., Ren, L., Pollefeys, M.: Accurate 3d pose estimation from a single depth image. In: IEEE International Conference on Computer Vision (ICCV), 2011, pp. 731鈥?38. IEEE, New York (2011)
    27. Zhang, H., Sheffer, A., Cohen-Or, D., Zhou, Q., Van Kaick, O., Tagliasacchi, A.: Deformation-driven shape correspondence. In: Computer Graphics Forum, vol. 27, pp. 1431鈥?439. Wiley Online Library, New York (2008)
    28. Zheng, Q., Sharf, A., Tagliasacchi, A., Chen, B., Zhang, H., Sheffer, A., Cohen-Or, D.: Consensus skeleton for non-rigid space-time registration. In: Computer Graphics Forum, vol. 29, pp. 635鈥?44. Wiley Online Library, New York (2010)
    29. Zhou, S., Fu, H., Liu, L., Cohen-Or, D., Han, X.: Parametric reshaping of human bodies in images. ACM Trans. Graph. 29(4), 126 (2010) CrossRef
  • 刊物类别：Computer Science
  • 刊物主题：Computer Graphics
    Computer Science, general
    Artificial Intelligence and Robotics
    Image Processing and Computer Vision
  • 出版者：Springer Berlin / Heidelberg
  • ISSN：1432-2315
文摘
In various applications of computer graphics and model-based computer vision, a human shape model cannot only model the kinematic properties of a subject to drive the mesh into various postures, but it can also be utilized to parameterize the shape variations across individuals. It is of great benefit to improve the diversity of the training databases by learning the model from multiple databases, once the correspondences among scans of these databases can be achieved. To accomplish this goal, we proposed a framework to match the scans from multiple databases, using the assistance of kinematic properties, to compute the correspondences. The resulting correspondence is accurate, robust, capable of handling scan incompletion, and is homogeneous across shapes and postures. In our approach, we start with evaluating how a correspondence, which is achieved via minimizing the deformation energy, agrees with the kinematic properties, and then, we jointly fit the source scans to the target scans to derive the correspondences between the databases. The extensive results show that our approach can generate a faithful correspondence even in extreme cases, without carefully selecting the deformation factors and markers. We also developed a method, with which a commendable and predictable result can be synthesized, to control the rendered shape in an intuitive way.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址：北京市海淀区学院路29号 邮编：100083

电话：办公室：(+86 10)66554848；文献借阅、咨询服务、科技查新：66554700