Online human moves recognition through discriminative key poses and speed-aware action graphs
详细信息 查看全文
- 作者：Thales Vieira ; Romain Faugeroux ; Dimas Martínez…
- 关键词：Gesture recognition ; Action recognition ; Machine learning ; Pose identification ; Depth sensors ; Natural user interface
- 刊名：Machine Vision and Applications
- 出版年：2017
- 出版时间：February 2017
- 年：2017
- 卷：28
- 期：1-2
- 页码：185-200
- 全文大小：
- 刊物类别：Computer Science
- 刊物主题：Pattern Recognition; Image Processing and Computer Vision; Communications Engineering, Networks;
- 出版者：Springer Berlin Heidelberg
- ISSN：1432-1769
- 卷排序：28
文摘
Recognizing user-defined moves serves a large number of applications including sport monitoring, virtual reality or natural user interfaces (NUI). However, many of the efficient human move recognition methods are still limited to specific situations, such as straightforward NUI gestures or everyday human actions. In particular, most methods depend on a prior segmentation of recordings to both train and recognize moves. This segmentation step is generally performed manually or based on heuristics such as neutral poses or short pauses, limiting the range of applications. Besides, speed is generally not considered as a criterion to distinguish moves. We present an approach composed of a simplified move training phase that requires minimal user intervention, together with a novel online method to robustly recognize moves online from unsegmented data without requiring any transitional pauses or neutral poses, and additionally considering human move speed. Trained gestures are automatically segmented in real time by a curvature-based method that detects small pauses during a training session. A set of most discriminant key poses between different moves is also extracted in real time, optimizing the number of key poses. All together, this semi-supervised learning approach only requires continuous move performances from the user with small pauses. Key pose transitions and moves execution speeds are used as input to a novel human move recognition algorithm that recognizes unsegmented moves online, achieving high robustness and very low latency in our experiments, while also effective in distinguishing moves that differ only in speed.