Repository logo
  • English
  • Deutsch
Log In
or
  1. Home
  2. HSG CRIS
  3. HSG Publications
  4. What do Deep Networks Like to See?
 
  • Details

What do Deep Networks Like to See?

Type
conference paper
Date Issued
2018-06-18
Author(s)
Sebastian, Palacio
Joachim, Folz
Federico, Raue
Damian, Borth  orcid-logo
Andreas, Dengel
Research Team
AIML Lab
Abstract
We propose a novel way to measure and understand convolutional neural networks by quantifying the amount of input signal they let in. To do this, an autoencoder (AE) was fine-tuned on gradients from a pre-trained classifier with fixed parameters. We compared the reconstructed samples from AEs that were fine-tuned on a set of image classifiers (AlexNet, VGG16, ResNet-50, and Inception~ v3) and found substantial differences. The AE learns which aspects of the input space to preserve and which ones to ignore, based on the information encoded in the backpropagated gradients. Measuring the changes in accuracy when the signal of one classifier is used by a second one, a relation of total order emerges. This order depends directly on each classifier's input signal but it does not correlate with classification accuracy or network size. Further evidence of this phenomenon is provided by measuring the normalized mutual information between original images and auto-encoded reconstructions from different fine-tuned AEs. These findings break new ground in the area of neural network understanding, opening a new way to reason, debug, and interpret their results. We present four concrete examples in the literature where observations can now be explained in terms of the input signal that a model uses.
Language
English
HSG Classification
contribution to scientific community
Publisher
IEEE
Start page
3108
End page
3117
Pages
9
Event Title
IEEE Int. Conf. on Computer Vision and Pattern Recognition (CVPR)
Event Location
Salt Lake City, Utah, United States
Event Date
Jun 18, 2018 – Jun 23, 2018
URL
https://www.alexandria.unisg.ch/handle/20.500.14171/100331
Subject(s)

computer science

Division(s)

ICS - Institute of Co...

Eprints ID
258249
File(s)
Loading...
Thumbnail Image

open.access

Name

Palacio_What_Do_Deep_CVPR_2018_paper.pdf

Size

2.31 MB

Format

Adobe PDF

Checksum (MD5)

f36d8765a9bf1dc29922899cd53c0b76

here you can find instructions and news.

Built with DSpace-CRIS software - Extension maintained and optimized by 4Science

  • Privacy policy
  • End User Agreement
  • Send Feedback