Deriving optimal data-analytic regimes from benchmarking studies

详细信息    查看全文

• 作者：Lisa L. Doove^a ; ^{lisa.doove@kuleuven.be} ; Tom F. Wilderjans^a ; ^b ; ^{t.f.wilderjans@fsw.leidenuniv.nl} ; Antonio Calcagnì ; ^a ; ^c ; ^{antonio.calcagni@unitn.it} ; Iven Van Mechelen^a ; ^{iven.vanmechelen@kuleuven.be}
• 关键词：Additive clustering ; Benchmarking ; Classification trees ; Comparison of methods ; Data-analytic regimes ; Supervised learning
• 刊名：Computational Statistics & Data Analysis
• 出版年：2017
• 出版时间：March 2017
• 年：2017
• 卷：107
• 期：Complete
• 页码：81-91
• 全文大小：996 K
• 卷排序：107

文摘

In benchmarking studies with simulated data sets in which two or more statistical methods are compared, over and above the search of a universally winning method, one may investigate how the winning method may vary over patterns of characteristics of the data or the data-generating mechanism. Interestingly, this problem bears strong formal similarities to the problem of looking for optimal treatment regimes in biostatistics when two or more treatment alternatives are available for the same medical problem or disease. It is outlined how optimal data-analytic regimes, that is to say, rules for optimally calling in statistical methods, can be derived from benchmarking studies with simulated data by means of supervised classification methods (e.g., classification trees). The approach is illustrated by means of analyses of data from a benchmarking study to compare two different algorithms for the estimation of a two-mode additive clustering model.