Evaluation of Spectral Learning for the Identification of Hidden Markov Models

详细信息    查看全文

• 作者：Robert Mattila¹ ; ^{rmattila@kth.se" class="auth_mail" title="E-mail the corresponding author} ; Cristian R. Rojas¹ ; ^{cristian.rojas@ee.kth.se" class="auth_mail" title="E-mail the corresponding author} ; Bo Wahlberg¹ ; ^{bo.wahlberg@ee.kth.se" class="auth_mail" title="E-mail the corresponding author}
• 关键词：spectral learning ; hidden Markov models ; HMM ; system identification ; spectral factorization ; method of moments ; performance evaluation
• 刊名：IFAC-PapersOnLine
• 出版年：2015
• 出版时间：2015
• 年：2015
• 卷：48
• 期：28
• 页码：897-902
• 全文大小：437 K

文摘

Hidden Markov models have successfully been applied as models of discrete time series in many fields. Often, when applied in practice, the parameters of these models have to be estimated. The currently predominating identification methods, such as maximum- likelihood estimation and especially expectation-maximization, are iterative and prone to have problems with local minima. A non-iterative method employing a spectral subspace-like approach has recently been proposed in the machine learning literature. This paper evaluates the performance of this algorithm, and compares it to the performance of the expectation- maximization algorithm, on a number of numerical examples. We find that the performance is mixed; it successfully identifies some systems with relatively few available observations, but fails completely for some systems even when a large amount of observations is available. An open question is how this discrepancy can be explained. We provide some indications that it could be related to how well-conditioned some system parameters are.