A new multi-purpose audio-visual UNMC-VIER database with multiple variabilities

详细信息    查看全文

• 作者：Yee Wan  ; Wong  ; ;   ; ^{yeewan.wong@nottingham.edu.my} ; Sue Inn  ; Ch&rsquo ; ng ; Kah Phooi  ; Seng ; Li-Minn  ; Ang ; Siew Wen  ; Chin ; Wei Jen  ; Chew ; King Hann  ; Lim
• 关键词：Audio-visual database ; Face recognition ; Speech recognition ; Visual variation
• 刊名：Pattern Recognition Letters
• 出版年：2011
• 出版时间：1 October 2011
• 年：2011
• 卷：32
• 期：13
• 页码：1503-1510
• 全文大小：596 K

文摘

Audio-visual recognition system is becoming popular because it overcomes certain problems of traditional audio-only recognition system. However, difficulties due to visual variations in video sequence can significantly degrade the recognition performance of the system. This problem can be further complicated when more than one visual variation happen at the same time. Although several databases have been created in this area, none of them includes realistic visual variations in video sequence. With the aim to facilitate the development of robust audio-visual recognition systems, the new audio-visual UNMC-VIER database is created. This database contains various visual variations including illumination, facial expression, head pose, and image resolution variations. The most unique aspect of this database is that it includes more than one visual variation in the same video recording. For the audio part, the utterances are spoken in slow and normal speech pace to improve the learning process of audio-visual speech recognition system. Hence, this database is useful for the development of robust audio-visual person, speech recognition and face recognition systems.