A heuristic algorithm to combat outliers and multicollinearity in regression model analysis

Iranian Journal of Numerical Analysis and Optimization

دوره 12، شماره 1 - شماره پیاپی 21، خرداد 2022، صفحه 173-186   

نوع مقاله: Original Article

شناسه دیجیتال (DOI): 10.22067/ijnao.2021.68160.1008

نویسندگان

M. Roozbeh^{* 1}؛ S. Babaie-Kafaki¹؛ M. Manavi²

¹Faculty of Mathematics, Statistics and Computer Science, P.O. Box: 35195-363, Semnan University, Semnan, Iran.

²Faculty of Mathematics, Statistics and Computer Science, Semnan University, Semnan, Iran

چکیده

As known, outliers and multicollinearity in the data set are among the important diffculties in regression models, which badly affect the leastsquares estimators. Under multicollinearity and outliers’ existence in the data set, the prediction performance of the least-squares regression method is decreased dramatically. Here, proposing an approximation for the condition number, we suggest a nonlinear mixed-integer programming model to simultaneously control inappropriate effects of the mentioned problems. The model can be effectively solved by popular metaheuristic algorithms. To shed light on importance of our optimization approach, we make some numerical experiments on a classic real data set as well as a simulated data set.

کلیدواژه‌ها

Condition number؛ Linear regression؛ Penalty method؛ Metaheuristic algorithm؛ Nonlinear mixed-integer programming

مراجع