Abstract
We observe that despite their hierarchical convolutional nature, the synthesis process of typical generative adversarial networks depends on absolute pixel coordinates in an unhealthy manner. This manifests itself as, e.g., detail appearing to be glued to image coordinates instead of the surfaces of depicted objects. We trace the root cause to careless signal processing that causes aliasing in the generator network. Interpreting all signals in the network as continuous, we derive generally applicable, small architectural changes that guarantee that unwanted information cannot leak into the hierarchical synthesis process. The resulting networks match the FID of StyleGAN2 but differ dramatically in their internal representations, and they are fully equivariant to translation and rotation even at subpixel scales. Our results pave the way for generative models better suited for video and animation.
Original language | English |
---|---|
Title of host publication | Advances in Neural Information Processing Systems 34 - 35th Conference on Neural Information Processing Systems, NeurIPS 2021 |
Editors | Marc'Aurelio Ranzato, Alina Beygelzimer, Yann Dauphin, Percy S. Liang, Jenn Wortman Vaughan |
Publisher | Neural Information Processing Systems Foundation |
Pages | 852-863 |
Number of pages | 12 |
ISBN (Electronic) | 9781713845393 |
Publication status | Published - 2021 |
MoE publication type | A4 Conference publication |
Event | Conference on Neural Information Processing Systems - Virtual, Online Duration: 6 Dec 2021 → 14 Dec 2021 Conference number: 35 https://neurips.cc |
Publication series
Name | Advances in Neural Information Processing Systems |
---|---|
Volume | 2 |
ISSN (Print) | 1049-5258 |
Conference
Conference | Conference on Neural Information Processing Systems |
---|---|
Abbreviated title | NeurIPS |
City | Virtual, Online |
Period | 06/12/2021 → 14/12/2021 |
Internet address |