FF-SKPCCA: Kernel probabilistic canonical correlation analysis

详细信息    查看全文

• 作者：Reza Rohani Sarvestani ; Reza Boostani
• 关键词：Feature fusion ; Canonical correlation analysis (CCA) ; Probabilistic CCA ; Kernel CCA
• 刊名：Applied Intelligence
• 出版年：2017
• 出版时间：March 2017
• 年：2017
• 卷：46
• 期：2
• 页码：438-454
• 全文大小：
• 刊物类别：Computer Science
• 刊物主题：Artificial Intelligence (incl. Robotics); Mechanical Engineering; Manufacturing, Machines, Tools;
• 出版者：Springer US
• ISSN：1573-7497
• 卷排序：46

文摘

Several information fusion methods are developed for increasing the recognition accuracy in multimodal systems. Canonical correlation analysis (CCA), cross-modal factor analysis (CFA) and their kernel versions are known as successful fusion techniques but they cannot digest the data variability. Probabilistic CCA (PCCA) is suggested as a linear fusion method to capture input variability. A new kernel PCCA (KPCCA) is proposed here to capture both the nonlinear correlations of sources and input variability. The functionality of KPCCA decreases when the number of samples, which determines the size of kernel matrix increases. In the conventional fusion methods the latent variables of different modalities are concatenated; consequently, a large-scale covariance matrix with just limited number of samples must be estimated To overcome this drawback, a sparse KPCCA (SKPCCA) is introduced which scarifies the covariance matrix elements at the cost of decreasing its rank. In the final stage of the gradual evolution of KPCCA, a new feature fusion manner is proposed for SKPCCA (FF-SKPCCA) as a second stage fusion. This proposed method unifies the latent variables of two modalities into a feature vector with an acceptable size. Audio-visual databases like M2VTS (for speech recognition) eNTERFACE and RML (for emotion recognition) are applied to assess FF-SKPCCA compared to state-of-the-art fusion methods. The comparative results indicate the superiority of the proposed method in most cases.