Automatic facial expression recognition based on spatiotemporal descriptors

详细信息	查看全文 | 推荐本文 |

• 作者：Yi Ji^a ; ^{jiyi@suda.edu.cn} ; ^{evelynji@gmail.com} ; Khalid Idrissi^b
• 关键词：Facial expression recognition ; Moments ; Spatialtemporal domain ; Vertical time backward ; Dynamic descriptor ; Support vector machine
• 刊名：Pattern Recognition Letters
• 出版年：2012
• 期刊代码：101_01678655
• 类别：cp
• 出版时间：15 July, 2012
• 卷：33
• 期：10
• 页码：1373-1380
• 文件大小：969 K

摘要

Facial expression鈥檚 machine analysis is one of the most challenging problems in Human-Computer Interaction (HCI). Naturally, facial expressions depend on subtle movements of facial muscles to show emotional states. After having studied the relations between basic expressions and corresponding facial deformation models, we propose two new textons, VTB and moments on spatiotemporal plane, to describe the transformation of human face during facial expressions. These descriptors aim at catching both general shape changes and motion texture details. Therefore, modeling the temporal behavior of facial expression captures the dynamic deformation of facial components. Finally, SVM based system is used to efficiently recognize the expression for a single image in sequence. Then, the probabilities of all the frames are used to predict the class of the current sequence. The experimental results are evaluated on both Cohan-Kanade and MMI databases. By comparison to other methods, the effectiveness of our method is clearly demonstrated.