Learning Image-to-Image Translation Using Paired and Unpaired Training Samples

Soumya Tripathy*, Juho Kannala, Esa Rahtu

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

1 Citation (Scopus)

Abstract

Image-to-image translation is a general name for a task where an image from one domain is converted to a corresponding image in another domain, given sufficient training data. Traditionally different approaches have been proposed depending on whether aligned image pairs or two sets of (unaligned) examples from both domains are available for training. While paired training samples might be difficult to obtain, the unpaired setup leads to a highly under-constrained problem and inferior results. In this paper, we propose a new general purpose image-to-image translation model that is able to utilize both paired and unpaired training data simultaneously. We compare our method with two strong baselines and obtain both qualitatively and quantitatively improved results. Our model outperforms the baselines also in the case of purely paired and unpaired training data. To our knowledge, this is the first work to consider such hybrid setup in image-to-image translation.

Original languageEnglish
Title of host publicationComputer Vision - ACCV 2018 - 14th Asian Conference on Computer Vision, Revised Selected Papers
EditorsKonrad Schindler, Greg Mori, C.V. Jawahar, Hongdong Li
Pages51-66
Number of pages16
DOIs
Publication statusPublished - 2019
MoE publication typeA4 Article in a conference publication
EventAsian Conference on Computer Vision - Perth, Australia
Duration: 2 Dec 20186 Dec 2018
Conference number: 14

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
PublisherSpringer Nature
Volume11362 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

ConferenceAsian Conference on Computer Vision
Abbreviated titleACCV
CountryAustralia
CityPerth
Period02/12/201806/12/2018

Fingerprint Dive into the research topics of 'Learning Image-to-Image Translation Using Paired and Unpaired Training Samples'. Together they form a unique fingerprint.

Cite this