Robust, Sparse and Scalable Inference Using Bootstrap and Variable Selection Fusion

Tutkimustuotos: Artikkeli kirjassa/konferenssijulkaisussaConference contributionScientificvertaisarvioitu

Abstrakti

In this paper, we address the challenging problem of conducting statistical inference for large-scale data sets in the presence of sparsity and outlying observations. In particular, processing and storing such data on a single computing node may be infeasible due to its high volume and dimensionality. Therefore, the large-scale data is subdivided into smaller distinct subsets that may be stored and processed in different nodes. We propose a robust and scalable statistical inference method using a two-stage algorithm where variable selection is performed via fusing the selected support from each distinct subset of data. The actual parameter and confidence interval estimation takes place in the second stage using a robust extension of Bag of Little Bootstraps (BLB) technique. In order to exploit sparsity and ensure robustness, MM-Lasso estimator is used to select variables for each subset of data. The selections are then fused to find the support for the original large-scale data. In the second stage, the robust MM-estimator is used for the selected support. The simulation studies demonstrated the highly reliable performance of the algorithm in variable selection and providing reliable confidence intervals even if the estimation problem in the subsets is slightly under-determined.

AlkuperäiskieliEnglanti
Otsikko2019 IEEE 8th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing, CAMSAP 2019 - Proceedings
KustantajaIEEE
Sivut271-275
Sivumäärä5
ISBN (elektroninen)9781728155494
DOI - pysyväislinkit
TilaJulkaistu - 1 jouluk. 2019
OKM-julkaisutyyppiA4 Artikkeli konferenssijulkaisuussa
TapahtumaIEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing - Guadeloupe, Le Gosier, Guadeloupe
Kesto: 15 jouluk. 201918 jouluk. 2019
https://camsap19.ig.umons.ac.be

Workshop

WorkshopIEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing
LyhennettäCAMSAP
Maa/AlueGuadeloupe
KaupunkiLe Gosier
Ajanjakso15/12/201918/12/2019
www-osoite

Sormenjälki

Sukella tutkimusaiheisiin 'Robust, Sparse and Scalable Inference Using Bootstrap and Variable Selection Fusion'. Ne muodostavat yhdessä ainutlaatuisen sormenjäljen.

Siteeraa tätä