TY - JOUR
T1 - High-dimensional structure learning of sparse vector autoregressive models using fractional marginal pseudo-likelihood
AU - Suotsalo, Kimmo
AU - Xu, Yingying
AU - Corander, Jukka
AU - Pensar, Johan
N1 - Funding Information:
This work was supported by RIKEN Special Postdoctoral Researcher Program (Yingying Xu). The authors wish to acknowledge CSC – IT Center for Science, Finland, for computational resources.
Publisher Copyright:
© 2021, The Author(s).
PY - 2021/11
Y1 - 2021/11
N2 - Learning vector autoregressive models from multivariate time series is conventionally approached through least squares or maximum likelihood estimation. These methods typically assume a fully connected model which provides no direct insight to the model structure and may lead to highly noisy estimates of the parameters. Because of these limitations, there has been an increasing interest towards methods that produce sparse estimates through penalized regression. However, such methods are computationally intensive and may become prohibitively time-consuming when the number of variables in the model increases. In this paper we adopt an approximate Bayesian approach to the learning problem by combining fractional marginal likelihood and pseudo-likelihood. We propose a novel method, PLVAR, that is both faster and produces more accurate estimates than the state-of-the-art methods based on penalized regression. We prove the consistency of the PLVAR estimator and demonstrate the attractive performance of the method on both simulated and real-world data.
AB - Learning vector autoregressive models from multivariate time series is conventionally approached through least squares or maximum likelihood estimation. These methods typically assume a fully connected model which provides no direct insight to the model structure and may lead to highly noisy estimates of the parameters. Because of these limitations, there has been an increasing interest towards methods that produce sparse estimates through penalized regression. However, such methods are computationally intensive and may become prohibitively time-consuming when the number of variables in the model increases. In this paper we adopt an approximate Bayesian approach to the learning problem by combining fractional marginal likelihood and pseudo-likelihood. We propose a novel method, PLVAR, that is both faster and produces more accurate estimates than the state-of-the-art methods based on penalized regression. We prove the consistency of the PLVAR estimator and demonstrate the attractive performance of the method on both simulated and real-world data.
KW - Fractional marginal likelihood
KW - Gaussian graphical models
KW - Multivariate time series
KW - Pseudo-likelihood
KW - Vector autoregression
UR - http://www.scopus.com/inward/record.url?scp=85115122105&partnerID=8YFLogxK
U2 - 10.1007/s11222-021-10049-z
DO - 10.1007/s11222-021-10049-z
M3 - Article
AN - SCOPUS:85115122105
SN - 0960-3174
VL - 31
JO - STATISTICS AND COMPUTING
JF - STATISTICS AND COMPUTING
IS - 6
M1 - 73
ER -