An introduction to Majorization-Minimization algorithms for machine learning and statistical estimation

详细信息    查看全文

• 作者：Hien D. Nguyen
• 刊名：Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery
• 出版年：2017
• 出版时间：March/April 2017
• 年：2017
• 卷：7
• 期：2
• 全文大小：343K
• ISSN：1942-4795

文摘

MM (majorization–minimization) algorithms are an increasingly popular tool for solving optimization problems in machine learning and statistical estimation. This article introduces the MM algorithm framework in general and via three commonly considered example applications: Gaussian mixture regressions, multinomial logistic regressions, and support vector machines. Specific algorithms for these three examples are derived and Mathematical Programming Series A numerical demonstrations are presented. Theoretical and practical aspects of MM algorithm design are discussed. WIREs Data Mining Knowl Discov 2017, 7:e1198. doi: 10.1002/widm.1198