Deep state-space Gaussian processes

Zheng Zhao*, Muhammad Emzir, Simo Särkkä

*Corresponding author for this work

Research output: Contribution to journalArticleScientificpeer-review

20 Downloads (Pure)

Abstract

This paper is concerned with a state-space approach to deep Gaussian process (DGP) regression. We construct the DGP by hierarchically putting transformed Gaussian process (GP) priors on the length scales and magnitudes of the next level of Gaussian processes in the hierarchy. The idea of the state-space approach is to represent the DGP as a non-linear hierarchical system of linear stochastic differential equations (SDEs), where each SDE corresponds to a conditional GP. The DGP regression problem then becomes a state estimation problem, and we can estimate the state efficiently with sequential methods by using the Markov property of the state-space DGP. The computational complexity scales linearly with respect to the number of measurements. Based on this, we formulate state-space MAP as well as Bayesian filtering and smoothing solutions to the DGP regression problem. We demonstrate the performance of the proposed models and methods on synthetic non-stationary signals and apply the state-space DGP to detection of the gravitational waves from LIGO measurements.

Original languageEnglish
Article number75
Number of pages26
JournalSTATISTICS AND COMPUTING
Volume31
Issue number6
DOIs
Publication statusPublished - Nov 2021
MoE publication typeA1 Journal article-refereed

Keywords

  • Deep Gaussian process
  • Gaussian filtering and smoothing
  • Gaussian process regression
  • Gravitational wave detection
  • Maximum a posteriori estimate
  • Particle filter
  • State space
  • Stochastic differential equation

Fingerprint

Dive into the research topics of 'Deep state-space Gaussian processes'. Together they form a unique fingerprint.

Cite this