Rethinking receiver operating characteristic analysis applications in ecological niche modeling
- 作者：A. Townsend Peterson ; Monica Papeş ; Jorge Soberó ; n
- 关键词：Ecological niche model ; Model evaluation ; Receiver operating characteristic ; Area under curve ; Omission error
- 刊名：Ecological Modelling
- 出版年：2008
- 期刊代码：49_03043800
- 类别：cp
- 出版时间：24 April 2008
- 卷：213
- 期：1
- 页码：63-72
- 文件大小：722 K
摘要
The area under the curve (AUC) of the receiver operating characteristic (ROC) has become a dominant tool in evaluating the accuracy of models predicting distributions of species. ROC has the advantage of being threshold-independent, and as such does not require decisions regarding thresholds of what constitutes a prediction of presence versus a prediction of absence. However, we show that, comparing two ROCs, using the AUC systematically undervalues models that do not provide predictions across the entire spectrum of proportional areas in the study area. Current ROC approaches in ecological niche modeling applications are also inappropriate because the two error components are weighted equally. We recommend a modification of ROC that remedies these problems, using partial-area ROC approaches to provide a firmer foundation for evaluation of predictions from ecological niche models. A worked example demonstrates that models that are evaluated favorably by traditional ROC AUCs are not necessarily the best when niche modeling considerations are incorporated into the design of the test.