Few-Shot Unsupervised Image-to-Image Translation

Ming-Yu Liu, Xun Huang, Arun Mallya, Tero Karras, Timo Aila, Jaakko Lehtinen, Jan Kautz

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

5 Citations (Scopus)
23 Downloads (Pure)

Abstract

Unsupervised image-to-image translation methods learn to map images in a given class to an analogous image in a different class, drawing on unstructured (non-registered) datasets of images. While remarkably successful, current methods require access to many images in both source and destination classes at training time. We argue this greatly limits their use. Drawing inspiration from the human capability of picking up the essence of a novel object from a small number of examples and generalizing from there, we seek a few-shot, unsupervised image-to-image translation algorithm that works on previously unseen target classes that are specified, at test time, only by a few example images. Our model achieves this few-shot generation capability by coupling an adversarial training scheme with a novel network design. Through extensive experimental validation and comparisons to several baseline methods on benchmark datasets, we verify the effectiveness of the proposed framework. Our implementation and datasets are available at https://github.com/NVlabs/FUNIT
Original languageEnglish
Title of host publicationProceedings of the International Conference on Computer Vision (ICCV2019)
PublisherIEEE
ISBN (Electronic)9781728148038
DOIs
Publication statusPublished - Feb 2020
MoE publication typeA4 Article in a conference publication
EventIEEE International Conference on Computer Vision - Seoul, Korea, Republic of
Duration: 27 Oct 20192 Nov 2019
http://iccv2019.thecvf.com/

Publication series

NameProceedings of the IEEE International Conference on Computer Vision
Volume2019-October
ISSN (Electronic)1550-5499

Conference

ConferenceIEEE International Conference on Computer Vision
Abbreviated titleICCV
CountryKorea, Republic of
CitySeoul
Period27/10/201902/11/2019
Internet address

Fingerprint Dive into the research topics of 'Few-Shot Unsupervised Image-to-Image Translation'. Together they form a unique fingerprint.

  • Cite this

    Liu, M-Y., Huang, X., Mallya, A., Karras, T., Aila, T., Lehtinen, J., & Kautz, J. (2020). Few-Shot Unsupervised Image-to-Image Translation. In Proceedings of the International Conference on Computer Vision (ICCV2019) (Proceedings of the IEEE International Conference on Computer Vision; Vol. 2019-October). IEEE. https://doi.org/10.1109/ICCV.2019.01065