Synthesis of sign language co-articulation based on key frames

详细信息    查看全文

• 作者：Shuo Li (1)
  Lichun Wang (1)
  Dehui Kong (1)
  
  1. Beijing Key Laboratory of Multimedia and Intelligent Software Technology ; College of Computer Science and Technology ; Beijing University of Technology ; Beijing ; 100124 ; Peoples Republic of China
  
• 关键词：Sign language ; Sign language synthesis ; Co ; articulation ; Motion edit
• 刊名：Multimedia Tools and Applications
• 出版年：2015
• 出版时间：March 2015
• 年：2015
• 卷：74
• 期：6
• 页码：1915-1933
• 全文大小：3,988 KB
• 参考文献：1. Chi D, Costa M, Zhao L, Badler N (2000) The EMOTE model for effort and shape. In: Proceedings of the 27th annual conference on Computer graphics and interactive techniques. SIGGRAPH鈥?0, New Orleans, Louisiana, USA, July 23鈥?8, 2000, pp 173鈥?82. doi:10.1145/344779.352172
  Chinese sign language. HuaXia Press, Beijing
  2. Conway, A, Veale, T (1994) A linguistic approach to sign language synthesis. In: People and Computers IX. Cambridge University Press, Cambridge
  3. Dasgupta T, Basu A (2008) Prototype machine translation system from text-to-Indian sign language. In: 13th International Conference on Intelligent User Interfaces. IUI鈥?8, Canary Islands, Spain, January 13鈥?6, 2008, pp 313鈥?16. doi:10.1145/1378773.1378818
  4. Delorme M, Filhol M, Braffort A (2009) Animation generation process for sign language synthesis. In: 2nd International Conferences on Advances in Computer-Human Interactions. ACHI鈥?9, Cancun, Mexico, February 1鈥?, 2009, pp 386鈥?90. doi:10.1109/ACHI.2009.29
  5. Grosvald M, Corina D (2008) Location-to-Location coarticulation: A phonetic investigation of American Sign Language. In: Proceedings of the 24th Northwest Linguistics Conference. NWLC鈥?8, Seattle, Washington, May 3鈥?, 2008, pp 59鈥?6
  6. Jerde, TE, Soechting, JF, Flanders, M (2003) Coarticulation in Fluent Fingerspelling. The Journal of Neuroscience 23: pp. 2383-2393
  7. Jerde, TE, Soechting, JF, Flanders, M (2003) Biological constraints simplify the recognition of hand shapes. IEEE Transactions on Biomedical Engineering 50: pp. 265-269 CrossRef
  8. Li S, Kong D, Wang L, Sun Y, Huang Q (2012) Optimal control theory based interpolation for Chinese sign language animation. In: The 15th International Conference on Geometry and Graphics. ICGG鈥?2, Montreal, Canada, August 1鈥?, 2012, pp 397鈥?02
  9. Liddell, SK (1984) Unrealized inceptive aspect in American sign language: feature insertion in syllabic frames. Chicago Linguistics Society 20: pp. 257-270
  10. Luo, W (2008) Study on the Handshape of Chinese sign language. Beijing Normal University, Dissertation
  11. Mauk CE (2003) Undershoot in two modalities: Evidence from fast speech and fast signing. Dissertation, University of Texas at Austin
  12. San-Segundo, R, Barra, R, C贸rdoba, R (2008) Speech to sign language translation system for Spanish. Speech Communication 50: pp. 1009-1020 CrossRef
  13. Segouat J, Braffort A (2009) Toward the study of sign language coarticulation: Methodology Proposal. In: Second International Conferences on Advances in Computer-Human Interactions. ACHI鈥?9, Cancun, Mexico, February 1鈥?, 2009, pp 369鈥?74. doi:10.1109/ACHI.2009.25
  14. Shantz, M, Poizner, H (1982) A computer program to synthesize American sign language. Behavior Research Methods and Instrumentation 14: pp. 467-474 CrossRef
  15. Sharieh A, Ellia G (2008) Toward international multi-sign languages. In: 19th International Conference on Database and Expert Systems Applications. DEXA鈥?8, Turin, Italy, September 1鈥?, 2008, pp 622鈥?25. doi:10.1109/DEXA.2008.129
  16. Sosnik, R, Hauptmann, B, Karni, A, Flash, T (2004) When practice leads to co-articulation: the evolution of geometrically defined movement primitives. Experimental Brain Research 156: pp. 422-438 CrossRef
  17. Stokoe, WC (1978) Sign language structure. Linstok Press, Silver Spring
  18. Stokoe, WC, Casterline, DC, Croneberg, CG (1976) A dictionary of American sign language on linguistic principles. Linstok Press, Silver Spring
  19. Sudarsky S, House D (2000) An integrated approach towards the representation, manipulation and reuse of prerecorded motion. In: Proceedings of Computer Animation. CA鈥?0, Philadelphia, PA, USA, 2000, pp 56鈥?1. doi:10.1109/CA.2000.889036
  20. Ye, K, Yin, B, Wang, L (2009) CSLML: a markup language for expressive Chinese sign language systhesis. Computer Animation and Virtual Worlds 20: pp. 237-245 CrossRef
  
• 刊物类别：Computer Science
• 刊物主题：Multimedia Information Systems
  Computer Communication Networks
  Data Structures, Cryptology and Information Theory
  Special Purpose and Application-Based Systems
  
• 出版者：Springer Netherlands
• ISSN：1573-7721

文摘

Co-articulation is a language phenomenon. In sign language (SL), it takes the form of impact among adjacent signs, which results in variations of signs from their standard configurations. Standard configuration is the appearance of a sign when it appears singly, without context. Without co-articulation, SL animation based on virtual character will be a simple concatenation of signs. The movement of virtual character will be mechanical, lacking fluency and realism. This paper presents a key frame based SL co-articulation animation scheme aiming at the three most important elements of co-articulation, i.e. hand shape, hand position and SL speed. To generate co-articulation, motion data of signs which appear sequentially is parsed to identify hand shapes and positions included in these signs. Then, co-articulation will be achieved through some modification to the motion data according to the interaction between adjacent hand shapes and adjacent hand positions. SL Speed acts as an adjusting parameter which dynamically impacts co-articulation. Different expression speed will lead to different degree of co-articulation.