Alias-Free Generative Adversarial Networks

Tero Karras, Miika Aittala, Samuli Laine, Erik Härkönen, Janne Hellsten, Jaakko Lehtinen, Timo Aila

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

850 Citations (Scopus)

Abstract

We observe that despite their hierarchical convolutional nature, the synthesis process of typical generative adversarial networks depends on absolute pixel coordinates in an unhealthy manner. This manifests itself as, e.g., detail appearing to be glued to image coordinates instead of the surfaces of depicted objects. We trace the root cause to careless signal processing that causes aliasing in the generator network. Interpreting all signals in the network as continuous, we derive generally applicable, small architectural changes that guarantee that unwanted information cannot leak into the hierarchical synthesis process. The resulting networks match the FID of StyleGAN2 but differ dramatically in their internal representations, and they are fully equivariant to translation and rotation even at subpixel scales. Our results pave the way for generative models better suited for video and animation.

Original languageEnglish
Title of host publicationAdvances in Neural Information Processing Systems 34 - 35th Conference on Neural Information Processing Systems, NeurIPS 2021
EditorsMarc'Aurelio Ranzato, Alina Beygelzimer, Yann Dauphin, Percy S. Liang, Jenn Wortman Vaughan
PublisherNeural Information Processing Systems Foundation
Pages852-863
Number of pages12
ISBN (Electronic)9781713845393
Publication statusPublished - 2021
MoE publication typeA4 Conference publication
EventConference on Neural Information Processing Systems - Virtual, Online
Duration: 6 Dec 202114 Dec 2021
Conference number: 35
https://neurips.cc

Publication series

NameAdvances in Neural Information Processing Systems
Volume2
ISSN (Print)1049-5258

Conference

ConferenceConference on Neural Information Processing Systems
Abbreviated titleNeurIPS
CityVirtual, Online
Period06/12/202114/12/2021
Internet address

Fingerprint

Dive into the research topics of 'Alias-Free Generative Adversarial Networks'. Together they form a unique fingerprint.

Cite this