Preprint

·2017 OPEN ACCESS

Robust and sparse estimation methods for high dimensional linear and logistic regression

Fatma Sevinç Kurnaz YTU , Irene Hoffmann , Peter Filzmoser

arXiv (Cornell University)

Abstract

Fully robust versions of the elastic net estimator are introduced for linear and logistic regression. The algorithms to compute the estimators are based on the idea of repeatedly applying the non-robust classical estimators to data subsets only. It is shown how outlier-free subsets can be identified efficiently, and how appropriate tuning parameters for the elastic net penalties can be selected. A final reweighting step improves the efficiency of the estimators. Simulation studies compare with non-robust and other competing robust estimators and reveal the superiority of the newly proposed methods. This is also supported by a reasonable computation time and by good performance in real data examples.

Keywords

Estimator Outlier Computation Robust statistics Elastic net regularization Computer science Logistic regression Robust regression Linear regression Mathematics Algorithm Regression Mathematical optimization Statistics Artificial intelligence Machine learning

Subject Areas

Advanced Statistical Methods and Models ·Statistics and Probability ·Physical Sciences
Advanced Statistical Process Monitoring ·Statistics, Probability and Uncertainty ·Social Sciences
Statistical Methods and Inference ·Statistics and Probability ·Physical Sciences

OpenAlex SDG Match

SDGs auto-classified by OpenAlex (score ≥ 0.4 shown).

Peace, Justice and strong institutions 48%