Boundary Extraction in Natural Images Using Ultrametric Contour Maps Pablo Arbeláez Université Paris Dauphine Presented by Derek Hoiem.

Slides:

Advertisements

Similar presentations

Shape Context and Chamfer Matching in Cluttered Scenes

Advertisements

Segmentation by Morphological Watersheds

Pose Estimation and Segmentation of People in 3D Movies Karteek Alahari, Guillaume Seguin, Josef Sivic, Ivan Laptev Inria, Ecole Normale Superieure ICCV.

A Graph based Geometric Approach to Contour Extraction from Noisy Binary Images Amal Dev Parakkat, Jiju Peethambaran, Philumon Joseph and Ramanathan Muthuganapathy.

November 12, 2013Computer Vision Lecture 12: Texture 1Signature Another popular method of representing shape is called the signature. In order to compute.

Spatially Constrained Segmentation of Dermoscopy Images

ADS lab NCKU1 Michael Maire, Pablo Arbelaez, Charless Fowlkes, and Jitendra Malik university of California, Berkeley – Berkeley university of California,

GrabCut Interactive Foreground Extraction using Iterated Graph Cuts Carsten Rother Vladimir Kolmogorov Andrew Blake Microsoft Research Cambridge-UK.

Interactive Image Segmentation using Graph Cuts Mayuresh Kulkarni and Fred Nicolls Digital Image Processing Group University of Cape Town PRASA 2009.

GrabCut Interactive Image (and Stereo) Segmentation Joon Jae Lee Keimyung University Welcome. I will present Grabcut – an Interactive tool for foreground.

1 P. Arbelaez, M. Maire, C. Fowlkes, J. Malik. Contour Detection and Hierarchical image Segmentation. IEEE Trans. on PAMI, Student: Hsin-Min Cheng.

Segmentation and Region Detection Defining regions in an image.

Ghunhui Gu, Joseph J. Lim, Pablo Arbeláez, Jitendra Malik University of California at Berkeley Berkeley, CA

On Constrained Optimization Approach To Object Segmentation Chia Han, Xun Wang, Feng Gao, Zhigang Peng, Xiaokun Li, Lei He, William Wee Artificial Intelligence.

Biased Normalized Cuts 1 Subhransu Maji and Jithndra Malik University of California, Berkeley IEEE Conference on Computer Vision and Pattern Recognition.

Grouping and Segmentation Computer Vision CS 543 / ECE 549 University of Illinois Derek Hoiem 03/01/10.

Recognition using Regions CVPR Outline Introduction Overview of the Approach Experimental Results Conclusion.

EE 7730 Image Segmentation.

Robust Higher Order Potentials For Enforcing Label Consistency

Fast, Multiscale Image Segmentation: From Pixels to Semantics Ronen Basri The Weizmann Institute of Science Joint work with Achi Brandt, Meirav Galun,

Learning to Detect Natural Image Boundaries Using Local Brightness, Color, and Texture Cues David R. Martin Charless C. Fowlkes Jitendra Malik.

EE663 Image Processing Edge Detection 2 Dr. Samir H. Abdul-Jauwad Electrical Engineering Department King Fahd University of Petroleum & Minerals.

Abstract We present a model of curvilinear grouping using piecewise linear representations of contours and a conditional random field to capture continuity.

1 Learning to Detect Natural Image Boundaries David Martin, Charless Fowlkes, Jitendra Malik Computer Science Division University of California at Berkeley.

Berkeley Vision GroupNIPS Vancouver Learning to Detect Natural Image Boundaries Using Local Brightness,

Color a* b* Brightness L* Texture Original Image Features Feature combination E D 22 Boundary Processing Textons A B C A B C 22 Region Processing.

An Iterative Optimization Approach for Unified Image Segmentation and Matting Hello everyone, my name is Jue Wang, I’m glad to be here to present our paper.

1 Ecological Statistics and Perceptual Organization Charless Fowlkes work with David Martin and Jitendra Malik at University of California at Berkeley.

The blue and green colors are actually the same.

Presentation By Michael Tao and Patrick Virtue. Agenda History of the problem Graph cut background Compute graph cut Extensions State of the art Continued.

CS292 Computational Vision and Language Segmentation and Region Detection.

Heather Dunlop : Advanced Perception January 25, 2006

Graph-based Segmentation

~5,617,000 population in each state

Segmentation and Grouping Computer Vision CS 543 / ECE 549 University of Illinois Derek Hoiem 02/23/10.

Computer Vision James Hays, Brown

Linked Edges as Stable Region Boundaries* Michael Donoser, Hayko Riemenschneider and Horst Bischof This work introduces an unsupervised method to detect.

Geodesic Minimal Paths Vida Movahedi Elder Lab, January 2010.

Multimodal Interaction Dr. Mike Spann

1Ellen L. Walker Segmentation Separating “content” from background Separating image into parts corresponding to “real” objects Complete segmentation Each.

Recognition using Regions (Demo) Sudheendra V. Outline Generating multiple segmentations –Normalized cuts [Ren & Malik (2003)] Uniform regions –Watershed.

1 Contours and Junctions in Natural Images Jitendra Malik University of California at Berkeley (with Jianbo Shi, Thomas Leung, Serge Belongie, Charless.

CS 1699: Intro to Computer Vision Edges and Binary Images Prof. Adriana Kovashka University of Pittsburgh September 15, 2015.

Image Segmentation and Morphological Processing Digital Image Processing in Life- Science Aviad Baram

Supervised Learning of Edges and Object Boundaries Piotr Dollár Zhuowen Tu Serge Belongie.

Data Extraction using Image Similarity CIS 601 Image Processing Ajay Kumar Yadav.

IIIT Hyderabad Learning Semantic Interaction among Graspable Objects Swagatika Panda, A.H. Abdul Hafez, C.V. Jawahar Center for Visual Information Technology,

Image gradients and edges Tuesday, September 1 st 2015 Devi Parikh Virginia Tech Disclaimer: Many slides have been borrowed from Kristen Grauman, who may.

Grouping and Segmentation

Modern Boundary Detection II Computer Vision CS 143, Brown James Hays Many slides Michael Maire, Jitendra Malek Szeliski 4.2.

1 Similarity-based matching for face authentication Christophe Rosenberger Luc Brun ICPR 2008.

Kylie Gorman WEEK 1-2 REVIEW. CONVERTING AN IMAGE FROM RGB TO HSV AND DISPLAY CHANNELS.

Image Segmentation in Color Space By Anisa Chaudhary.

Category Independent Region Proposals Ian Endres and Derek Hoiem University of Illinois at Urbana-Champaign.

Edge Based Segmentation Xinyu Chang. Outline Introduction Canny Edge detector Edge Relaxation Border Tracing.

Filtering Objective –improve SNR and CNR Challenges – blurs object boundaries and smears out important structures.

A New Method for Crater Detection Heather Dunlop November 2, 2006.

Face Detection Final Presentation Mark Lee Nic Phillips Paul Sowden Andy Tait 9 th May 2006.

Machine Vision Edge Detection Techniques ENT 273 Lecture 6 Hema C.R.

Performance Measurement of Image Processing Algorithms By Dr. Rajeev Srivastava ITBHU, Varanasi.

Image Features (I) Dr. Chang Shu COMP 4900C Winter 2008.

Representation in Vision Derek Hoiem CS 598, Spring 2009 Jan 22, 2009.

04/11/13 Collections of Sets Discrete Structures (CS 173) Derek Hoiem, University of Illinois 1.

Finding Boundaries Computer Vision CS 143, Brown James Hays 09/28/11 Many slides from Lana Lazebnik, Steve Seitz, David Forsyth, David Lowe, Fei-Fei Li,

Color Image Segmentation Mentor : Dr. Rajeev Srivastava Students: Achit Kumar Ojha Aseem Kumar Akshay Tyagi.

Cutting Images: Graphs and Boundary Finding Computational Photography Derek Hoiem, University of Illinois 09/20/12 “The Double Secret”, Magritte.

Image gradients and edges

Segmentation Computer Vision Spring 2018, Lecture 27

Image gradients and edges April 11th, 2017

“Traditional” image segmentation

Presentation transcript:

Boundary Extraction in Natural Images Using Ultrametric Contour Maps Pablo Arbeláez Université Paris Dauphine Presented by Derek Hoiem

What is segmentation?

Segmentation is a result

What is segmentation? Segmentation is a result Segmentation is a process Woman Face

What is segmentation? Segmentation is a result Segmentation is a process Segmentation is a guide

Segmentation as a Guide Multiple Segmentations

Segmentation as a Guide Multiple Segmentations Hierarchy of Segmentations

Key Concepts/Contributions Hierarchical segmentation by iterative merging Ultrametric dissimilarities Thorough evaluation on BSDS

Hierarchical Segmentation λ 3 Region ImageDendrogram Contour Image

Ultrametric Contour Map Ultrametric –Definition: D(x,y) <= max{ D(x,z), D(z,y) } The union R 12 of two regions R 1 and R 2 must have >= distance to adjacent region R 3 than either R 1 or R 2 λ

Ultrametric Contour Map

Region Dissimilarity 1.D c (R 1, R 2 ): mean boundary contrast –contrast(x) = max L*a*b* diff within radius of x 2.D g (R 1, R 2 ): mean boundary gradient –gradient(x) = Pb(x) 3.D a (R 1 ): Area + α 3 Scatter (in color space) D(R 1, R 2 ) = [D c (R 1, R 2 ) + α 1 D g (R 1, R 2 )] · min{ D a (R 1 ), D a (R 2 ) } α2α2 Learned Parameters: x i = 4.5 α 1 = 5 α 2 = 0.2 α 3 = 0

Examples Contrast Contrast + Gradient Contrast + Gradient + Region

Algorithm Summary Create Initial Contours: –Extrema in gray channel form regions –Assign pixels to regions based on above ultrametric Iteratively merge regions –Keep adjacency/distance matrix

Comparison Martin et al. (Pb) Canny edge detector Hierarchical watersheds (using MFM for gradient) [Najman and Schmitt 1996] Variational (global energy minimization)

Pb No Boundary Boundary [Martin Fowlkes Malik 2004] Oriented Edges Brightness Gradient Color Gradient Texture Gradient

Pb

Variational Method [Koepfler Lopez Morel 1994] Originally Wavelet-based Textons

Comparison MFM: Martin et al. (Pb) Canny: Canny edge detector WS: Hierarchical watersheds (using MFM for gradient) [Najman and Schmitt 1996] MS: Variational (global energy minimization) Edge-BasedRegion-Based

Comparison

Results

Best Results

Best Results

Best Results

Best Results

Median Results

Worst Results

Hierarchies vs. Multiple Segmentations

Revising Segmentation