Self-taught Object Localization with Deep Networks

Speaker:  Loris Bazzani - Dartmouth College
  Thursday, July 23, 2015 at 5:00 PM 16:45 rinfresco; 17:00 inizio seminario
The reliance on plentiful and detailed manual annotations for training is a critical limitation of the current state of the art in object localization and detection. This talk presents self-taught object localization, a novel approach that leverages deep convolutional networks trained for whole-image recognition to localize objects in images without additional human supervision, i.e., without using any ground-truth bounding boxes for training. The key idea is to analyze the change in the recognition scores when artificially masking out different regions of the image. The masking out of a region that contains an object typically causes a significant drop in recognition. This idea is embedded into an agglomerative clustering technique that generates self-taught localization hypotheses. Our experiments on a challenging dataset of 200 classes indicate that our automatically-generated annotations are accurate enough to train object detectors yielding to recognition results remarkably close to those obtained by training on manually-annotated bounding boxes.

Ca' Vignal 2, Floor 1, Lecture Hall L

Contact person
Marco Cristani

Publication date
July 13, 2015