Practical variable selection for generalized additive models

详细信息    查看全文

• 作者：Giampiero Marra^a ; ^{giampiero@stats.ucl.ac.uk} ; Simon N. Wood^b
• 关键词：Generalized additive model ; Nonnegative garrote estimator ; Penalized thin plate regression spline ; Practical variable selection ; Shrinkage smoother
• 刊名：Computational Statistics and Data Analysis
• 出版年：2011
• 出版时间：1 July 2011
• 年：2011
• 卷：55
• 期：7
• 页码：2372-2387
• 全文大小：971 K

文摘

The problem of variable selection within the class of generalized additive models, when there are many covariates to choose from but the number of predictors is still somewhat smaller than the number of observations, is considered. Two very simple but effective shrinkage methods and an extension of the nonnegative garrote estimator are introduced. The proposals avoid having to use nonparametric testing methods for which there is no general reliable distributional theory. Moreover, component selection is carried out in one single step as opposed to many selection procedures which involve an exhaustive search of all possible models. The empirical performance of the proposed methods is compared to that of some available techniques via an extensive simulation study. The results show under which conditions one method can be preferred over another, hence providing applied researchers with some practical guidelines. The procedures are also illustrated analysing data on plasma beta-carotene levels from a cross-sectional study conducted in the United States.