Discriminative two-level feature selection for realistic human action recognition

详细信息    查看全文

• 作者：Qiuxia Wu ; Zhiyong Wang ; Feiqi Deng ; Yong Xia ; Wenxiong Kang ; David Dagan Feng
• 关键词：Realistic human action recognition ; Visual saliency ; Space&ndash ; time interest points ; Unsupervised codeword selection ; Maximal information compression index ; Bag-of-features model ; Saliency map ; Support vector machine
• 刊名：Journal of Visual Communication and Image Representation
• 出版年：2013
• 出版时间：October, 2013
• 年：2013
• 卷：24
• 期：7
• 页码：1064-1074
• 全文大小：4800 K

文摘

Constructing the bag-of-features model from Space-time interest points (STIPs) has been successfully utilized for human action recognition. However, how to eliminate a large number of irrelevant STIPs for representing a specific action in realistic scenarios as well as how to select discriminative codewords for effective bag-of-features model still need to be further investigated. In this paper, we propose to select more representative codewords based on our pruned interest points algorithm so as to reduce computational cost as well as improve recognition performance. By taking human perception into account, attention based saliency map is employed to choose salient interest points which fall into salient regions, since visual saliency can provide strong evidence for the location of acting subjects. After salient interest points are identified, each human action is represented with the bag-of-features model. In order to obtain more discriminative codewords, an unsupervised codeword selection algorithm is utilized. Finally, the Support Vector Machine (SVM) method is employed to perform human action recognition. Comprehensive experimental results on the widely used and challenging Hollywood-2 Human Action (HOHA-2) dataset and YouTube dataset demonstrate that our proposed method is computationally efficient while achieving improved performance in recognizing realistic human actions.