Isometry invariant similarity

Slides:



Advertisements
Similar presentations
3D reconstruction.
Advertisements

Differential geometry I
Spectral methods 1 © Alexander & Michael Bronstein,
CLUSTERING PROXIMITY MEASURES
Projective Geometry- 3D
Topology-Invariant Similarity and Diffusion Geometry
1 Numerical Geometry of Non-Rigid Shapes Diffusion Geometry Diffusion geometry © Alexander & Michael Bronstein, © Michael Bronstein, 2010 tosca.cs.technion.ac.il/book.
Discrete Geometry Tutorial 2 1
Isometry-Invariant Similarity
Discrete geometry Lecture 2 1 © Alexander & Michael Bronstein
1 Numerical geometry of non-rigid shapes Geometry Numerical geometry of non-rigid shapes Shortest path problems Alexander Bronstein, Michael Bronstein,
1 Numerical geometry of non-rigid shapes Consistent approximation of geodesics in graphs Consistent approximation of geodesics in graphs Tutorial 3 © Alexander.
Shape reconstruction and inverse problems
Invariant correspondence
1 Processing & Analysis of Geometric Shapes Shortest path problems Shortest path problems The discrete way © Alexander & Michael Bronstein, ©
1 Michael Bronstein Shapes as metric spaces: deformation-invariant similarity Michael Bronstein Computational metric geometry: an old new tool in image.
1 Michael Bronstein Computational metric geometry Computational metric geometry Michael Bronstein Department of Computer Science Technion – Israel Institute.
1 Numerical geometry of non-rigid shapes Partial similarity Partial similarity © Alexander & Michael Bronstein, © Michael Bronstein, 2010 tosca.cs.technion.ac.il/book.
1 Processing & Analysis of Geometric Shapes Introduction Processing and Analysis of Geometric Shapes Department of Electrical Engineering – Technion Spring.
Multidimensional scaling
Numerical Optimization
1 Numerical geometry of non-rigid shapes Lecture I – Introduction Numerical geometry of shapes Lecture I – Introduction non-rigid Michael Bronstein.
Spectral embedding Lecture 6 1 © Alexander & Michael Bronstein
Numerical geometry of non-rigid shapes
Numerical geometry of objects
1 Bronstein 2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes Michael M. Bronstein Department of Computer Science Technion – Israel Institute.
Lecture IV – Invariant Correspondence
1 Numerical geometry of non-rigid shapes Mathematical background Mathematical background Tutorial 1 © Maks Ovsjanikov, Alex & Michael Bronstein tosca.cs.technion.ac.il/book.
Correspondence & Symmetry
1 Numerical geometry of non-rigid shapes Partial similarity Partial Similarity Alexander Bronstein, Michael Bronstein © 2008 All rights reserved. Web:
1 Numerical geometry of non-rigid shapes Spectral Methods Tutorial. Spectral Methods Tutorial 6 © Maks Ovsjanikov tosca.cs.technion.ac.il/book Numerical.
1 Numerical geometry of non-rigid shapes Lecture II – Numerical Tools Numerical geometry of shapes Lecture II – Numerical Tools non-rigid Alex Bronstein.
Spectral Embedding Alexander Bronstein, Michael Bronstein
Differential geometry II
Numerical geometry of non-rigid shapes
1 Numerical geometry of non-rigid shapes In the Rigid Kingdom In the Rigid Kingdom Lecture 4 © Alexander & Michael Bronstein tosca.cs.technion.ac.il/book.
1 Numerical geometry of non-rigid shapes A journey to non-rigid world objects Invariant correspondence and shape synthesis non-rigid Alexander Bronstein.
1 Bronstein, Bronstein, and Kimmel Joint extrinsic and intrinsic similarity of non-rigid shapes Rock, paper, and scissors Joint extrinsic and intrinsic.
Invariant Correspondence
1 Regularized partial similarity of shapes NORDIA – CVPR 2008 Not only size matters: Regularized partial similarity of shapes Alexander Bronstein, Michael.
1 Numerical geometry of non-rigid shapes Spectral embedding Conclusions I hope that posterity will judge me kindly, not only as to the things which I have.
1 Numerical geometry of non-rigid shapes A journey to non-rigid world objects Numerical methods non-rigid Alexander Bronstein Michael Bronstein Numerical.
Non-Euclidean Embedding
1 Numerical geometry of non-rigid shapes Introduction Numerical geometry of non-rigid shapes Introduction Alexander Bronstein, Michael Bronstein, Ron Kimmel.
1 Numerical geometry of non-rigid shapes Numerical Geometry Numerical geometry of non-rigid shapes Numerical geometry Alexander Bronstein, Michael Bronstein,
Numerical geometry of non-rigid shapes
Paretian similarity for partial comparison of non-rigid objects
1 Bronstein 2 & Kimmel An isometric model for facial animation and beyond AMDO, Puerto de Andratx, 2006 An isometric model for facial animation and beyond.
1 Numerical Geometry of Non-Rigid Shapes Invariant shape similarity Invariant shape similarity © Alexander & Michael Bronstein, © Michael Bronstein,
1 Numerical geometry of non-rigid shapes Non-Euclidean Embedding Non-Euclidean Embedding Lecture 6 © Alexander & Michael Bronstein tosca.cs.technion.ac.il/book.
1 Numerical geometry of non-rigid shapes Expression-invariant face recognition Expression-invariant face recognition Lecture 8 © Alexander & Michael Bronstein.
1 Numerical geometry of non-rigid shapes Three-Dimensional Face Recognition Three Dimensional Face Recognition “And in stature he is small, chest broad,
1 Michael M. Bronstein Partial similarity of objects 17 December 2006 Partial similarity of objects, or how to compare a centaur to a horse Michael M.
1 Bronstein 2 & Kimmel Matching 2D articulated shapes using GMDS AMDO, Puerto de Andratx, 2006 Matching 2D articulated shapes using Generalized Multidimensional.
1 Numerical geometry of non-rigid shapes A journey to non-rigid world objects Introduction non-rigid Alexander Bronstein Michael Bronstein Numerical geometry.
1 M. Bronstein Multigrid multidimensional scaling Multigrid Multidimensional Scaling Michael M. Bronstein Department of Computer Science Technion – Israel.
1 Numerical geometry of non-rigid shapes Non-rigid correspondence Numerical geometry of non-rigid shapes Non-rigid correspondence Alexander Bronstein,
1 Numerical geometry of non-rigid shapes Nonrigid Correspondence & Calculus of Shapes Non-Rigid Correspondence and Calculus of Shapes Of bodies changed.
1 Numerical geometry of non-rigid shapes Shortest path problems Shortest path problems Lecture 2 © Alexander & Michael Bronstein tosca.cs.technion.ac.il/book.
Expression-invariant Face Recognition using Geodesic Distance Isometries Kerry Widder A Review of ‘Robust expression-invariant face recognition from partially.
Introduction Image geometry studies rotation, translation, scaling, distortion, etc. Image topology studies, e.g., (i) the number of occurrences.
1 Numerical geometry of non-rigid shapes Projects Quasi-isometries Project 1 © Alexander & Michael Bronstein tosca.cs.technion.ac.il/book Numerical geometry.
Set Theory Concepts Set – A collection of “elements” (objects, members) denoted by upper case letters A, B, etc. elements are lower case brackets are used.
Chapter 3 The Real Numbers.
Morphing and Shape Processing
Chapter 3 The Real Numbers.
Spectral Methods Tutorial 6 1 © Maks Ovsjanikov
I.4 Polyhedral Theory.
Computational Mechanics of ECAs, and Machine Metrics
Locality In Distributed Graph Algorithms
Presentation transcript:

Isometry invariant similarity Lecture 7 © Alexander & Michael Bronstein tosca.cs.technion.ac.il/book Numerical geometry of non-rigid shapes Stanford University, Winter 2009 1

Invariant similarity SIMILARITY TRANSFORMATION 2

Equivalence Equal Congruent Isometric

Equivalence Equivalence is a binary relation on the space of shapes which for all satisfies Reflexivity: Symmetry: Transitivity: Can be expressed as a binary function if and only if Quotient space is the space of equivalence classes

Equivalence

All deformations of the human shape are “the same” Equivalence All deformations of the human shape are “the same”

Similarity Shapes are rarely truly equivalent (e.g., due to acquisition noise or since most shapes are rigid) We want to account for “almost equivalence” or similarity -similar = -isometric (w.r.t. some metric) Define a distance on the shape space quantifying the degree of dissimilarity of shapes

A monkey shape is more similar to a deformation of a monkey shape… Similarity …than to a human shape A monkey shape is more similar to a deformation of a monkey shape…

Isometry-invariant distance Non-negative function satisfying for all Similarity: and are -isometric; and are -isometric (In particular, if and only if ) Symmetry: Triangle inequality: Corollary: is a metric on the quotient space Given discretized shapes and sampled with radius Consistency to sampling:

Compute Hausdorff distance over all isometries in Canonical forms distance Minimum-distortion embedding Minimum-distortion embedding Compute Hausdorff distance over all isometries in No fixed embedding space will give distortion-less canonical forms

Gromov-Hausdorff distance Isometric embedding Isometric embedding Gromov-Hausdorff distance: include into minimization Mikhail Gromov

Properties of Gromov-Hausdorff distance Metric on the quotient space of isometries of shapes Similarity: and are -isometric; and are -isometric Consistent to sampling: given discretized shapes and sampled with radius Generalization of Hausdorff distance: Hausdorff distance between subsets of a metric space Gromov-Hausdorff distance between metric spaces Gromov, 1981

Alternative definition I (metric coupling) where is the disjoint union of and the (semi-) metric satisfies and Mémoli, 2008

Alternative definition I (metric coupling) Optimization over translates into finding the values of A lot of constraints! Mémoli, 2008

Correspondence A subset is called a correspondence between and if for every there exists at least one such that and similarly for every there exists such that Particular case: given and

Correspondence distortion The distortion of correspondence is defined as In the particular case of , consider the following cases for If the distortion is

Correspondence distortion (cont) Case 1 Case 3 Case 2 Otherwise, the distortion is given by Therefore,

Alternative definition II (correspondence distortion) Proof sketch 1. Show that for any there exists with Since , by definition of , and are subspaces of some such that Let By triangle inequality, for

Alternative definition II (correspondence distortion) 2. Show that for any Let It is sufficient to show that there is a (semi-)metric on the disjoint union such that , , and Construct the metric as follows (in particular, for ).

Alternative definition II (correspondence distortion) First, For each Since for , Second, we need to show that is a (semi-)metric on On and , it is straightforward We only need to show metric properties hold on

Alternative definition III measures how much is distorted by when embedded into

Alternative definition III measures how much is distorted by when embedded into

Alternative definition III measures how far is from being the inverse of

Generalized MDS A. Bronstein, M. Bronstein & R. Kimmel, 2006

Discrete Gromov-Hausdorff distance Two coupled GMDS problems Can be cast as a constrained problem Bronstein, Bronstein & Kimmel, 2006

Gromov-Hausdorff distance Numerical example Canonical forms (MDS based on 500 points) Gromov-Hausdorff distance (GMDS based on 50 points) Bronstein, Bronstein & Kimmel, 2006

Extrinsic similarity using Gromov-Hausdorff distance Congruence Euclidean isometry ICP distance: GH distance with Euclidean metric: Connection between Euclidean GH and ICP distances: Mémoli (2008) Mémoli, 2008

Connection to canonical form distance

Correspondence again A different representation for correspondence using indicator functions defines a valid correspondence if

Lp Gromov-Hausdorff distance We can give an alternative formulation of the Gromov-Hausdorff distance Can we define an Lp version of the Gromov-Hausdorff distance by relaxing the above definition?

Measure coupling Let be probability measures defined on and (a metric space with measure is called a metric measure or mm space) A measure on is a coupling of and if for all measurable sets The measure can be considered as a relaxed version of the indicator function or as fuzzy correspondence Mémoli, 2007

Gromov-Wasserstein distance The relaxed version of the Gromov-Hausdorff distance is given by and is referred to as Gromov-Wasserstein distance [Memoli 2007] Mémoli, 2007

Earth Mover’s distance Let be a metric space, and measures supported on Define the coupling of The Wasserstein or Earth Mover’s distance (EMD) is given by EMD as optimal mass transport: mass transported from to distance traveled Mémoli, 2007

The analogy Hausdorff Wasserstein Gromov-Hausdorff Gromov-Wasserstein Distance between subsets of a metric space . Distance between subsets of a metric measure space . Gromov-Hausdorff Gromov-Wasserstein Distance between metric spaces Distance between metric measure spaces Mémoli, 2007