Selective overview of forward selection in terms of robust correlations

Forward selection (FS) is a very effective variable selection procedure for selecting a parsimonious subset of covariates from a large number of candidate covariates. Detecting the type of outlying observations, such as vertical outliers or leverage points, and the FS procedure are inseparable probl...

Full description

Saved in:
Bibliographic Details
Main Authors: Uraibi, Hassan Sami, Midi, Habshah, Rana, Sohel
Format: Article
Language:English
Published: Taylor & Francis 2017
Online Access:http://psasir.upm.edu.my/id/eprint/63189/1/Selective%20overview%20of%20forward%20selection%20in%20terms%20of%20robust%20correlations.pdf
http://psasir.upm.edu.my/id/eprint/63189/
https://www.tandfonline.com/doi/abs/10.1080/03610918.2016.1164862?journalCode=lssp20
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Forward selection (FS) is a very effective variable selection procedure for selecting a parsimonious subset of covariates from a large number of candidate covariates. Detecting the type of outlying observations, such as vertical outliers or leverage points, and the FS procedure are inseparable problems. For robust variable selection, a crucial issue is whether the outliers are univariate, bivariate, or multivariate. This paper uses a consistent robust multivariate dispersion estimator to obtain robust correlation estimators used to establish robust forward selection (RFS) procedures that outperform methods that use robust bivariate correlations. The usefulness of our proposed procedure is studied with a numerical example and a simulation study. The result shows the proposed method has scalability and the ability to deal with univariate, bivariate and multivariate outlying observations including leverage points or vertical outliers, and the new method outperforms previously published methods of RFS.