Multimodal features fusion for gait, gender and shoes recognition
详细信息 查看全文
- 作者：Francisco M. Castro ; Manuel J. Marín-Jiménez…
- 关键词：Gait recognition ; Feature fusion ; Audio ; Depth ; Gender recognition
- 刊名：Machine Vision and Applications
- 出版年：2016
- 出版时间：November 2016
- 年：2016
- 卷：27
- 期：8
- 页码：1213-1228
- 全文大小：
- 刊物类别：Computer Science
- 刊物主题：Pattern Recognition; Image Processing and Computer Vision; Communications Engineering, Networks;
- 出版者：Springer Berlin Heidelberg
- ISSN：1432-1769
- 卷排序：27
文摘
The goal of this paper is to evaluate how the fusion of multimodal features (i.e., audio, RGB and depth) can help in the challenging task of people identification based on their gait (i.e., the way they walk), or gait recognition, and by extension to the tasks of gender and shoes recognition. Most of previous research on gait recognition has focused on designing visual descriptors, mainly on binary silhouettes, or building sophisticated machine learning frameworks. However, little attention has been paid to audio or depth patterns associated with the action of walking. So, we propose and evaluate here a multimodal system for gait recognition. The proposed approach is evaluated on the challenging ‘TUM GAID’ dataset, which contains audio and depth recordings in addition to image sequences. The experimental results show that using either early or late fusion techniques to combine feature descriptors from three kinds of modalities (i.e., RGB, depth and audio) improves the state-of-the-art results on the standard experiments defined on the dataset for the tasks of gait, gender and shoes recognition. Additional experiments on CASIA-B (where only visual modality is available) support the benefits of feature fusion as well.