Conditioning diffusion models by explicit forward-backward bridging

Adrien Corenflos, Zheng Zhao, Simo Särkkä, Jens Sjölund, Thomas B. Schön

Tutkimustuotos: LehtiartikkeliConference articleScientificvertaisarvioitu

7 Lataukset (Pure)

Abstrakti

Given an unconditional diffusion model targeting a joint model π(x, y), using it to perform conditional simulation π(x | y) is still largely an open question and is typically achieved by learning conditional drifts to the denoising SDE after the fact. In this work, we express exact conditional simulation within the approximate diffusion model as an inference problem on an augmented space corresponding to a partial SDE bridge. This perspective allows us to implement efficient and principled particle Gibbs and pseudo-marginal samplers marginally targeting the conditional distribution π(x | y). Contrary to existing methodology, our methods do not introduce any additional approximation to the unconditional diffusion model aside from the Monte Carlo error. We showcase the benefits and drawbacks of our approach on a series of synthetic and real data examples.

AlkuperäiskieliEnglanti
Sivut3709-3717
Sivumäärä9
JulkaisuProceedings of Machine Learning Research
Vuosikerta258
TilaJulkaistu - 2025
OKM-julkaisutyyppiA4 Artikkeli konferenssijulkaisussa
TapahtumaInternational Conference on Artificial Intelligence and Statistics - Splash Beach Resort, Mai Khao, Thaimaa
Kesto: 3 toukok. 20255 toukok. 2025
Konferenssinumero: 28
https://aistats.org/aistats2025/

Rahoitus

The original idea and methodology are due to AC and subsequently refined jointly by AC and ZZ. Implementation and experimental evaluation are mostly due to ZZ with help and inputs from AC. Writing was primarily done by AC with substantial help from ZZ and inputs from TS. All authors edited and validated the final manuscript. This work was partially supported by the Kjell och M\u00E4rta Beijer Foundation, Wallenberg AI, Autonomous Systems and Software Program (WASP) funded by the Knut and Alice Wallenberg Foundation, the project Deep probabilistic regression - new models and learning algorithms (contract number: 2021-04301), funded by the Swedish Research Council, and by the Research Council of Finland. The computations were enabled by the Berzelius resource provided by the Knut and Alice Wallenberg Foundation at the National Supercomputer Centre. Adrien Corenflos and Simo S\u00E4rkk\u00E4 were partially supported by the Research Council of Finland. Adrien Corenflos also acknowledges the financial support provided by UKRI for OCEAN (a 2023-2029 ERC Synergy grant co-sponsored by UKRI).

Sormenjälki

Sukella tutkimusaiheisiin 'Conditioning diffusion models by explicit forward-backward bridging'. Ne muodostavat yhdessä ainutlaatuisen sormenjäljen.

Siteeraa tätä