Robust Variables Selection via the Reciprocal Lasso with an Exponential Squared Loss Function
DOI:
https://doi.org/10.29304/jqcsm.2025.17.32288Keywords:
Exponential, loss function, Lasso, Reciprocal LassoAbstract
Variable selection procedures in regression models have gained increasing attention. They can be used to perform variable selection and are expected to yield accurate estimates. However, there are a number of assumptions in regression models and one of them related with assuming the normal distribution for the error term. The variables selection methods are not robust to outliers. One of the variables selection methods is the rLasso and it is not robust to outliers. A method has been proposed to make rLasso robust to variable selection by relying on an exponential squared loss function instead of the least squares loss function, which is sensitive to outliers. The effectiveness of the proposed method, which is robust to outliers in X and Y, has been demonstrated through simulations and real data.In this paper, we propose robust penalized regression estimator based on an exponential squared loss function, the motivation behind this proposal is that it enables us to introduce robust variable selection method. performance is outperforms the exsisting methods when the outliers are founded. Specifically, under different setting. We conducted simulation studies to compare our proposed method with some existing methods. Our simulation study shows that the proposed method performs well in terms of mean square error and average number of zero coefficients in the presence of significant outliers.
Downloads
References
Akaike, H. (1973). Information theory and an extension of the maximum likelihood principle. In B. N. Petrov & F. Csáki (Eds.), Proceedings of the 2nd International Symposium on Information Theory (pp. 267–281). Budapest: Akadémiai Kiadó.
Efroymson, M. A. (1960). Multiple regression analysis. In B. L. Magidson (Ed.), Mathematical Methods for Digital Computers (pp. 191–203). John Wiley & Sons.
Fan, J., and Li, R. (2001), “Variable Selection via Nonconcave Penalized Like-lihood and Its Oracle Properties,” Journal of the American Statistical Asso-ciation, 96, 1348–1360.
Frank, I. E., & Friedman, J. H. (1993). A statistical view of some chemometrics regression tools (with discussion). Technometrics, 35(2), 109–148.
Hahn, G., Lutz, S., Lange, C., & Munz, M. (2020). Inverse Lasso: A New Approach to Sparse Estimation with Nonconvex Penalty. Statistical Papers, 61(3), 995–1014. https://doi.org/10.1007/s00362-018-
Johnson, B. A., & Peng, L. (2008). Rank‑based Variable Selection. Journal of Nonparametric Statistics, 20(3), 241–25
Li, J., Sun, F., & Zhang, W. (2023). Robust variable selection in spatial single-index varying-coefficient models using exponential squared loss. Entropy, 25(2), 230. https://doi.org/10.3390/e25020230
Mishra, P., & Liland, K. H. (2023). Iterative re weighted covariates selection for robust feature selection modelling in the presence of outliers (irCovSel). Journal of Chemometrics, 37(2), Article e3458. https://doi.org/10.1002/cem.3458
Robust variable selection using weighted Wilcoxon-type SCAD.Statistics and Computing, 19(3), 263–276. https://doi.org/10.1007/s11222-008-9089-7
Rousseeuw, P. J., & Driessen, K. V. (1999). A fast algorithm for the minimum covariance determinant estimator. Technometrics, 41(3), 212–223. https://doi.org/10.1080/00401706.1999.10485670
Shen, X., Pan, W., & Zhu, Y. (2014). Robust variable selection with nonconvex penalized M-estimators. Journal of the American Statistical Association, 109(505), 668–680.
Simon, N., Friedman, J., Hastie, T., and Tibshirani, R. (2013). A sparse-group lasso. Journal of Computational and Graphical Statistics, 22(2),
Song, Q., & Liang, H. (2015). Variable selection in linear models with reciprocal Lasso. Journal of Statistical Planning and Inference, 166, 119–127. https://doi.org/10.1016/j.jspi.2015.04.001
Wang, H., Li, G., and Jiang, G. (2013). Robust Variable Selection with Exponential Squared Loss. Journal of the American Statistical Association.
Wang, X., Li, Y., and Leng, C. (2020). Adaptive Lasso for high-dimensional linear regression. Journal of Computational and Graphical Statistics, 29(1), 154–163. https://doi.org/10.1080/10618600.2019.1572217
Yohai, V., and Zamar, R. (1988), “High Breakdown-Point Estimates of Regres-sion by Means of the Minimization of an Efficient Scale,” Journal of the American Statistical Association, 83, 406–413
Yuan, M., & Lin, Y. (2006). Model selection and estimation in regression with grouped variables. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 68(1), 49–67. https://doi.org/10.1111/j.1467-9868.2005.00532.x
Zou, H. (2006), “The Adaptive Lasso and Its Oracle Properties,” Journal of the American Statistical Association, 101, 1418–1429.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Naàel .H. Taklef, Ali. J. Alkenani

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.





