GAN Dissection: Visualizing and Understanding Generative Adversarial Networks

On 2020-03-12 11:00:00 at G205, Karlovo náměstí 13, Praha 2
Reading group on the work "GAN Dissection: Visualizing and Understanding
Generative Adversarial Networks", David Bau, Jun-Yan Zhu, Hendrik Strobelt,
Bolei Zhou, Joshua B. Tenenbaum, William T. Freeman, Antonio Torralba. ICLR
2019. Presented by Jakub Žitný

Paper abstract: Generative Adversarial Networks (GANs) have recently achieved
impressive results for many real-world applications, and many GAN variants have
emerged with improvements in sample quality and training stability. However,
they have not been well visualized or understood. How does a GAN represent our
visual world internally? What causes the artifacts in GAN results? How do
architectural choices affect GAN learning? Answering such questions could
enable us to develop new insights and better models. In this work, we present
analytic framework to visualize and understand GANs at the unit-, object-, and
scene-level. We first identify a group of interpretable units that are closely
related to object concepts using a segmentation-based network dissection
method. Then, we quantify the causal effect of interpretable units by measuring
ability of interventions to control objects in the output. We examine the
contextual relationship between these units and their surroundings by inserting
the discovered object concepts into new images. We show several practical
applications enabled by our framework, from comparing internal representations
across different layers, models, and datasets, to improving GANs by locating
and removing artifact-causing units, to interactively manipulating objects in a
scene. We provide open source interpretation tools to help researchers and
practitioners better understand their GAN models.

Paper URL:

Instructions for participants: The reading group studies the literature in the
field of pattern recognition and computer vision. At each meeting one or more
papers are prepared for presentation by a single person, the presenter. The
meetings are open to anyone, disregarding their background. It is assumed that
everyone attending the reading group has, at least briefly, read the paper –
not necessarily understanding everything. Attendants should preferably send
questions about the unclear parts to the speaker at least one day in advance.
During the presentation we aim to have a fruitful discussion, a critical
analysis of the paper, as well as brainstorming for creative extensions.

See the page of reading groups
Responsible person: Petr Pošík