Variable selection with genetic algorithm and multivariate adaptive regression splines in the presence of multicollinearity

Abstract

In this paper, it is aimed to determine the true regressors explaining the dependent variable in multiple linear regression models and also to find the best model by using two different approaches in the presence of low, medium and high multicollinearity. These approaches compared in this study are genetic algorithm and multivariate adaptive regression splines. A comprehensive Monte Carlo experiment is performed in order to examine the performance of these approaches. This study exposes that nonparametric methods can be preferred for variable selection in order to obtain the best model when there is a multicollinearity problem in the small, medium or large data sets