Interactive Image Cutout- Lazy Snapping

Slides:



Advertisements
Similar presentations
Interactively Co-segmentating Topically Related Images with Intelligent Scribble Guidance Dhruv Batra, Carnegie Mellon University Adarsh Kowdle, Cornell.
Advertisements

SOFT SCISSORS: AN INTERACTIVE TOOL FOR REALTIME HIGH QUALITY MATTING International Conference on Computer Graphics and Interactive Techniques ACM SIGGRAPH.
Cutting Images: Graphs and Boundary Finding Computational Photography Derek Hoiem, University of Illinois 09/15/11 “The Double Secret”, Magritte.
Graph cut Chien-chi Chen.
I Images as graphs Fully-connected graph – node for every pixel – link between every pair of pixels, p,q – similarity w ij for each link j w ij c Source:
GrabCut Interactive Image (and Stereo) Segmentation Carsten Rother Vladimir Kolmogorov Andrew Blake Antonio Criminisi Geoffrey Cross [based on Siggraph.
GrabCut Interactive Foreground Extraction using Iterated Graph Cuts Carsten Rother Vladimir Kolmogorov Andrew Blake Microsoft Research Cambridge-UK.
GrabCut Interactive Foreground Extraction using Iterated Graph Cuts Carsten Rother Vladimir Kolmogorov Andrew Blake Microsoft Research Cambridge-UK.
A Gimp Plugin that uses “GrabCut” to perform image segmentation
Graph-Based Image Segmentation
Each pixel is 0 or 1, background or foreground Image processing to
Stephen J. Guy 1. Photomontage Photomontage GrabCut – Interactive Foreground Extraction 1.
1 s-t Graph Cuts for Binary Energy Minimization  Now that we have an energy function, the big question is how do we minimize it? n Exhaustive search is.
Graph-based image segmentation Václav Hlaváč Czech Technical University in Prague Faculty of Electrical Engineering Department of Cybernetics Prague, Czech.
GrabCut Interactive Image (and Stereo) Segmentation Joon Jae Lee Keimyung University Welcome. I will present Grabcut – an Interactive tool for foreground.
Interactive Image Segmentation 1. Image Segmentation Problem Segmentation refers to the process of partitioning an image into multiple non-overlapping.
CS 691 Computational Photography Instructor: Gianfranco Doretto Cutting Images.
Image Segmentation some examples Zhiqiang wang
CS448f: Image Processing For Photography and Vision Graph Cuts.
Segmentation Using Max Flow/Min Cut Graph Cuts Based on "An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision.“
1Ellen L. Walker Segmentation Separating “content” from background Separating image into parts corresponding to “real” objects Complete segmentation Each.
Region Segmentation. Find sets of pixels, such that All pixels in region i satisfy some constraint of similarity.
Segmentation and Clustering. Segmentation: Divide image into regions of similar contentsSegmentation: Divide image into regions of similar contents Clustering:
Stereo & Iterative Graph-Cuts Alex Rav-Acha Vision Course Hebrew University.
Advanced Topics in Computer Vision Spring 2006 Video Segmentation Tal Kramer, Shai Bagon Video Segmentation April 30 th, 2006.
MRF Labeling With Graph Cut CMPUT 615 Nilanjan Ray.
Stereo Computation using Iterative Graph-Cuts
Comp 775: Graph Cuts and Continuous Maximal Flows Marc Niethammer, Stephen Pizer Department of Computer Science University of North Carolina, Chapel Hill.
The Segmentation Problem
Image Segmentation Today’s Readings Forsyth & Ponce, Chapter 14
Perceptual Organization: Segmentation and Optical Flow.
Image Segmentation by Clustering using Moments by, Dhiraj Sakumalla.
Image Segmentation Rob Atlas Nick Bridle Evan Radkoff.
MRFs and Segmentation with Graph Cuts Computer Vision CS 543 / ECE 549 University of Illinois Derek Hoiem 03/31/15.
Prakash Chockalingam Clemson University Non-Rigid Multi-Modal Object Tracking Using Gaussian Mixture Models Committee Members Dr Stan Birchfield (chair)
Cutting Images: Graphs and Boundary Finding Computational Photography Derek Hoiem, University of Illinois 09/14/10 “The Double Secret”, Magritte.
Graph Cut & Energy Minimization
Graph-based Segmentation. Main Ideas Convert image into a graph Vertices for the pixels Vertices for the pixels Edges between the pixels Edges between.
MRFs and Segmentation with Graph Cuts Computer Vision CS 543 / ECE 549 University of Illinois Derek Hoiem 02/24/10.
7.1. Mean Shift Segmentation Idea of mean shift:
CS774. Markov Random Field : Theory and Application Lecture 13 Kyomin Jung KAIST Oct
2008 International Conference on Multimedia & Expo GRAPH CUTS BY USING LOCAL TEXTURE FEATURES OF WAVELET COEFFICIENT FOR IMAGE SEGMENTATION Keita Fukuda,
Interactive Graph Cuts for Optimal Boundary & Region Segmentation of Objects in N-D Images (Fri) Young Ki Baik, Computer Vision Lab.
Chap 3 : Binary Image Analysis. Counting Foreground Objects.
CS 6825: Binary Image Processing – binary blob metrics
Digital Image Processing CCS331 Relationships of Pixel 1.
Graph Cuts Marc Niethammer. Segmentation by Graph-Cuts A way to compute solutions to the optimization problems we looked at before. Example: Binary Segmentation.
CS 4487/6587 Algorithms for Image Analysis
Chapter 10, Part II Edge Linking and Boundary Detection The methods discussed in the previous section yield pixels lying only on edges. This section.
Gaussian Mixture Models and Expectation-Maximization Algorithm.
CS654: Digital Image Analysis Lecture 28: Advanced topics in Image Segmentation Image courtesy: IEEE, IJCV.
Outline Standard 2-way minimum graph cut problem. Applications to problems in computer vision Classical algorithms from the theory literature A new algorithm.
Computational Photography lecture 8 – segmentation CS (future 572) Spring 2016 Prof. Alex Berg (Credits to many other folks on individual slides)
Color Image Segmentation Mentor : Dr. Rajeev Srivastava Students: Achit Kumar Ojha Aseem Kumar Akshay Tyagi.
Cutting Images: Graphs and Boundary Finding Computational Photography Derek Hoiem, University of Illinois 09/20/12 “The Double Secret”, Magritte.
Image segmentation.
MRFs and Segmentation with Graph Cuts Computer Vision CS 543 / ECE 549 University of Illinois Derek Hoiem 03/27/12.
Graph-based Segmentation
Cutting Images: Graphs and Boundary Finding
Project Progress and Future Plans By: Matthew Marsh
COMP 9517 Computer Vision Segmentation 7/2/2018 COMP 9517 S2, 2017.
Markov Random Fields with Efficient Approximations
Dingding Liu* Yingen Xiong† Linda Shapiro* Kari Pulli†
Graph Cut Weizhen Jing
Lecture 31: Graph-Based Image Segmentation
Digital Image Processing
“grabcut”- Interactive Foreground Extraction using Iterated Graph Cuts
“Traditional” image segmentation
Presentation transcript:

Interactive Image Cutout- Lazy Snapping Hu Junfeng 2015-11-25 “Lazy Snapping”, SIGGRAPH 2004 Yin Li, Jian Sun, Chi-Keung Tang, Heung-Yeung Shum

Interactive image cutout Lazy snapping Demo Grabcut Image cutout is the technique of removing an object from its background

Interactive image cutout Lazy snapping Demo Grabcut Image cutout is the technique of removing an object from its background

Lazy snapping Step 1: a quick object marking step Work at a coarse scale Specifies the object of interest by a few marking lines Step 2: a simple boundary editing step Work at a finer scale Edit the object boundary by simply clicking and dragging polygon vertices

Object marking UI design Representative clustering centers Two groups of lines for the representative parts of foreground and background Representative clustering centers K-means method to obtain 64 clusters for each class : for foreground : for background

K-means clustering Iterating the 4 steps below Seed initialization Assigning elements Seed updating Assigning again

Object marking Foreground/background image segmentation A typical graph-cut problem Intuition: classifying the pixels into two groups, which has the Similar feature in this group; each group has the smoothness assumption, a Commonly used prior knowledge

Graph cut image segmentation An image cutout problem can be posed as a binary labelling problem on a graph G=(V, E) V: the nodes represent all the pixels E: the edge linking two neighboring pixels (4-neighborhood) i: the i-th node Background Foreground Edge

Graph cut image segmentation Corresponding to above 2 intuitive steps Define the likelihood energy : Define the prior energy : Minimize the above two terms simultaneously Encoding the cost when the label of node i is xi The smaller, the better Encoding the cost when the label of node i and node j is xi and xj The smaller, the better

Graph cut image segmentation The likelihood energy The prior energy

Graph cuts Min cut == Max flow

Max flow problem Bottleneck problem General algorithms: Ford-Fulkerson algorithm, push-relabel maximum flow new algorithm by Boykov, etc

Boundary editing Boundary as editable polygon UI design/Tools First vertex – border pixel with highest curvature Next vertices: furthest boundary pixel from previous polygon Stop when distance is below some threshold UI design/Tools Direct vertex editing Overriding brush Using graph cuts

Experimental results

分组大作业 Project 1 彩色直方图均衡优化 1人组 时间:12月11号 Project 2 图像分割 2人组 提交时间:12月11号