Synthesizing mood-affected signed messages: Modifications to the parametric synthesis

详细信息    查看全文

• 作者：Fernando Ló ; pez-Colino ; ^{fj.lopez@uam.es} ; José ; Colá ; s ^{jose.colas@uam.es}
• 关键词：Sign language synthesis ; Frame of mind synthesis ; Graphical interface ; Deaf people
• 刊名：International Journal of Human-Computer Studies
• 出版年：2012
• 出版时间：April 2012
• 年：2012
• 卷：70
• 期：4
• 页码：271-286
• 全文大小：1172 K

文摘

This paper describes the first approach in synthesizing mood-affected signed contents. The research focuses on the modifications applied to a parametric sign language synthesizer (based on phonetic descriptions of the signs). We propose some modifications that will allow for the synthesis of different perceived frames of mind within synthetic signed messages. Three of these proposals focus on modifications to three different signs' phonologic parameters (the hand shape, the movement and the non-hand parameter). The other two proposals focus on the temporal aspect of the synthesis (sign speed and transition duration) and the representation of muscular tension through inverse kinematics procedures. These resulting variations have been evaluated by Spanish deaf signers, who have concluded that our system can generate the same signed message with three different frames of mind, which are correctly identified by Spanish Sign Language signers.