Open Access Open Access  Restricted Access Subscription Access

Variable Selection and Parameter Estimation with the Atan Regularization Method


Affiliations
1 School of Science, Ningbo University of Technology, Ningbo 315211, China
2 School of Applied Mathematics, Xiamen University of Technology, Xiamen 361024, China
 

Variable selection is fundamental to high-dimensional statistical modeling. Many variable selection techniques may be implemented by penalized least squares using various penalty functions. In this paper, an arctangent type penalty which very closely resembles l0 penalty is proposed; we call it Atan penalty. The Atan-penalized least squares procedure is shown to consistently select the correct model and is asymptotically normal, provided the number of variables grows slower than the number of observations. The Atan procedure is efficiently implemented using an iteratively reweighted Lasso algorithm. Simulation results and data example show that the Atan procedure with BIC-type criterion performs very well in a variety of settings.
User
Notifications
Font Size

Abstract Views: 78

PDF Views: 0




  • Variable Selection and Parameter Estimation with the Atan Regularization Method

Abstract Views: 78  |  PDF Views: 0

Authors

Yanxin Wang
School of Science, Ningbo University of Technology, Ningbo 315211, China
Zhu Li
School of Applied Mathematics, Xiamen University of Technology, Xiamen 361024, China

Abstract


Variable selection is fundamental to high-dimensional statistical modeling. Many variable selection techniques may be implemented by penalized least squares using various penalty functions. In this paper, an arctangent type penalty which very closely resembles l0 penalty is proposed; we call it Atan penalty. The Atan-penalized least squares procedure is shown to consistently select the correct model and is asymptotically normal, provided the number of variables grows slower than the number of observations. The Atan procedure is efficiently implemented using an iteratively reweighted Lasso algorithm. Simulation results and data example show that the Atan procedure with BIC-type criterion performs very well in a variety of settings.