Facial expression recognition experiments with data from television broadcasts and the World Wide Web
详细信息 查看全文
- 作者：Ligang Zhang ; Dian Tjondronegoro ; Vinod Ch ; ran
- 关键词：Facial expression recognition ; Realistic ; Texture ; Geometry ; Experiment
- 刊名：Image and Vision Computing
- 出版年：February, 2014
- 年：2014
- 卷：32
- 期：2
- 页码：107-119
- 全文大小：1959 K
文摘
Facial expression recognition (FER) systems must ultimately work on real data in uncontrolled environments although most research studies have been conducted on lab-based data with posed or evoked facial expressions obtained in pre-set laboratory environments. It is very difficult to obtain data in real-world situations because privacy laws prevent unauthorized capture and use of video from events such as funerals, birthday parties, marriages etc. It is a challenge to acquire such data on a scale large enough for benchmarking algorithms. Although video obtained from TV or movies or postings on the World Wide Web may also contain 鈥榓cted鈥?emotions and facial expressions, they may be more 鈥榬ealistic鈥?than lab-based data currently used by most researchers. Or is it? One way of testing this is to compare feature distributions and FER performance. This paper describes a database that has been collected from television broadcasts and the World Wide Web containing a range of environmental and facial variations expected in real conditions and uses it to answer this question. A fully automatic system that uses a fusion based approach for FER on such data is introduced for performance evaluation. Performance improvements arising from the fusion of point-based texture and geometry features, and the robustness to image scale variations are experimentally evaluated on this image and video dataset. Differences in FER performance between lab-based and realistic data, between different feature sets, and between different train-test data splits are investigated.