TY - JOUR
T1 - Graphical LASSO based Model Selection for Time Series
AU - Jung, A.
AU - Hannak, G.
AU - Goertz, N.
PY - 2015/10/1
Y1 - 2015/10/1
N2 - We propose a novel graphical model selection scheme for high-dimensional stationary time series or discrete time processes. The method is based on a natural generalization of the graphical LASSO algorithm, introduced originally for the case of i.i.d. samples, and estimates the conditional independence graph of a time series from a finite length observation. The graphical LASSO for time series is defined as the solution of an l1-regularized maximum (approximate) likelihood problem. We solve this optimization problem using the alternating direction method of multipliers. Our approach is nonparametric as we do not assume a finite dimensional parametric model, but only require the process to be sufficiently smooth in the spectral domain. For Gaussian processes, we characterize the performance of our method theoretically by deriving an upper bound on the probability that our algorithm fails. Numerical experiments demonstrate the ability of our method to recover the correct conditional independence graph from a limited amount of samples.
AB - We propose a novel graphical model selection scheme for high-dimensional stationary time series or discrete time processes. The method is based on a natural generalization of the graphical LASSO algorithm, introduced originally for the case of i.i.d. samples, and estimates the conditional independence graph of a time series from a finite length observation. The graphical LASSO for time series is defined as the solution of an l1-regularized maximum (approximate) likelihood problem. We solve this optimization problem using the alternating direction method of multipliers. Our approach is nonparametric as we do not assume a finite dimensional parametric model, but only require the process to be sufficiently smooth in the spectral domain. For Gaussian processes, we characterize the performance of our method theoretically by deriving an upper bound on the probability that our algorithm fails. Numerical experiments demonstrate the ability of our method to recover the correct conditional independence graph from a limited amount of samples.
KW - Gaussian processes
KW - graph theory
KW - maximum likelihood estimation
KW - time series
KW - Gaussian process
KW - conditional independence graph
KW - discrete time process
KW - finite dimensional parametric model
KW - finite length observation
KW - graphical LASSO algorithm
KW - graphical model selection scheme
KW - high-dimensional stationary time series
KW - l1-regularized maximum likelihood problem
KW - optimization problem
KW - Algorithm design and analysis
KW - Estimation error
KW - Graphical models
KW - Linear programming
KW - Signal processing algorithms
KW - Time series analysis
KW - Upper bound
KW - ADMM
KW - graphical LASSO
KW - graphical model selection
KW - nonparametric time series
KW - sparsity
U2 - 10.1109/LSP.2015.2425434
DO - 10.1109/LSP.2015.2425434
M3 - Article
SN - 1070-9908
VL - 22
SP - 1781
EP - 1785
JO - IEEE Signal Processing Letters
JF - IEEE Signal Processing Letters
IS - 10
M1 - 7091904
ER -