Bridging the Gap Between Paired and Unpaired Medical Image Translation

Pauliina Paavilainen*, Saad Ullah Akram, Juho Kannala

*Tämän työn vastaava kirjoittaja

Tutkimustuotos: Artikkeli kirjassa/konferenssijulkaisussaConference article in proceedingsScientificvertaisarvioitu

5 Sitaatiot (Scopus)

Abstrakti

Medical image translation has the potential to reduce the imaging workload, by removing the need to capture some sequences, and to reduce the annotation burden for developing machine learning methods. GANs have been used successfully to translate images from one domain to another, such as MR to CT. At present, paired data (registered MR and CT images) or extra supervision (e.g. segmentation masks) is needed to learn good translation models. Registering multiple modalities or annotating structures within each of them is a tedious and laborious task. Thus, there is a need to develop improved translation methods for unpaired data. Here, we introduce modified pix2pix models for tasks CT → MR and MR → CT, trained with unpaired CT and MR data, and MRCAT pairs generated from the MR scans. The proposed modifications utilize the paired MR and MRCAT images to ensure good alignment between input and translated images, and unpaired CT images ensure the MR → CT model produces realistic-looking CT and CT → MR model works well with real CT as input. The proposed pix2pix variants outperform baseline pix2pix, pix2pixHD and CycleGAN in terms of FID and KID, and generate more realistic looking CT and MR translations.

AlkuperäiskieliEnglanti
OtsikkoDeep Generative Models, and Data Augmentation, Labelling, and Imperfections
AlaotsikkoFirst Workshop, DGM4MICCAI 2021, and First Workshop, DALI 2021, Held in Conjunction with MICCAI 2021, Proceedings
ToimittajatSandy Engelhardt, Ilkay Oksuz, Dajiang Zhu, Yixuan Yuan, Anirban Mukhopadhyay, Nicholas Heller, Sharon Xiaolei Huang, Hien Nguyen, Raphael Sznitman, Yuan Xue
KustantajaSpringer
Sivut35-44
Sivumäärä10
ISBN (elektroninen)9783030882105
ISBN (painettu)9783030882099
DOI - pysyväislinkit
TilaJulkaistu - 25 syysk. 2021
OKM-julkaisutyyppiA4 Artikkeli konferenssijulkaisussa
TapahtumaInternational Conference on Medical Image Computing and Computer Assisted Intervention - Virtual, Online
Kesto: 27 syysk. 20211 lokak. 2021
https://www.miccai2021.org/

Julkaisusarja

NimiLecture Notes in Computer Science
Vuosikerta13003 LNCS
ISSN (painettu)0302-9743
ISSN (elektroninen)1611-3349

Conference

ConferenceInternational Conference on Medical Image Computing and Computer Assisted Intervention
LyhennettäMICCAI
KaupunkiVirtual, Online
Ajanjakso27/09/202101/10/2021
www-osoite

Sormenjälki

Sukella tutkimusaiheisiin 'Bridging the Gap Between Paired and Unpaired Medical Image Translation'. Ne muodostavat yhdessä ainutlaatuisen sormenjäljen.

Siteeraa tätä