Performance evaluation of competing forecasting models: A multidimensional framework based on MCDA

详细信息	查看全文 | 推荐本文 |

• 作者：Bing Xu^a ; Jamal Ouenniche^b ; ^c ; ^{Jamal.Ouenniche@ed.ac.uk}
• 关键词：Forecasting models ; Performance evaluation ; Multi-Criteria Decision Analysis ; Crude oil prices
• 刊名：Expert Systems with Applications
• 出版年：2012
• 期刊代码：62_09574174
• 类别：et
• 出版时间：July, 2012
• 卷：39
• 期：9
• 页码：8312-8324
• 文件大小：1921 K

摘要

So far, competing forecasting models are compared to each other using a single criterion at a time, which often leads to different rankings for different criteria - a situation where one cannot make an informed decision as to which model performs best overall; that is, taking all performance criteria into account. To overcome this methodological problem, we propose to use a Multi-Criteria Decision Analysis (MCDA) based framework and discuss how one might adapt it to address the problem of relative performance evaluation of competing forecasting models. Three outranking methods have been used in our empirical experiments to rank order competing forecasting models of crude oil prices; namely, ELECTRE III, PROMETHEE I, and PROMETHEE II. Our empirical results reveal that the multidimensional framework provides a valuable tool to apprehend the true nature of the relative performance of competing forecasting models. In addition, as far as the evaluation of the relative performance of the forecasting models considered in this study is concerned, the rankings of the best and the worst performing models do not seem to be sensitive to the choice of importance weights or outranking methods, which suggest that the ranks of these models are robust.