Presentation on theme: "Challenges to image parsing researchers Lana Lazebnik UNC Chapel Hill sky sidewalk building road car person car mountain."— Presentation transcript:
Challenges to image parsing researchers Lana Lazebnik UNC Chapel Hill sky sidewalk building road car person car mountain
The past: “closed universe” datasets Tens of classes, hundreds of images, offline learning He et al. (2004), Hoiem et al. (2005), Shotton et al. (2006, 2008, 2009), Verbeek and Triggs (2007), Rabinovich et al. (2007), Galleguillos et al. (2008), Gould et al. (2009), etc. Figure from Shotton et al. (2009)
Evolving images, annotations http://labelme.csail.mit.edu/ The future: “open universe” datasets
Non-uniform class frequencies The future: “open universe” datasets
Combination of local cues? Multiple segmentations/grouping hypotheses? Context? Graphical models (MRFs, CRFs, etc.)? Offline learning and inference? Which “closed universe” techniques can survive in the “open universe” setting?
Learning from all of LabelMe 50K images, 232 labels sky tree road car sky sea sun building window door road sky building mountain sky building sidewalk car road car ceiling wall floor Tighe & Lazebnik, work in progress
Learning from all of LabelMe 50K images, 232 labels Per-class classification rates Tighe & Lazebnik, work in progress