CENG 789 – Digital Geometry Processing 04- Distances, Descriptors and Sampling on Meshes Asst. Prof. Yusuf Sahillioğlu Computer Eng. Dept,, Turkey.

Slides:



Advertisements
Similar presentations
Multiple Shape Correspondence by Dynamic Programming Yusuf Sahillioğlu 1 and Yücel Yemez 2 Pacific Graphics 2014 Computer Eng. Depts, 1, 2, Turkey.
Advertisements

Extended Gaussian Images
Semi-Supervised Hierarchical Models for 3D Human Pose Reconstruction Atul Kanaujia, CBIM, Rutgers Cristian Sminchisescu, TTI-C Dimitris Metaxas,CBIM, Rutgers.
Topology-Invariant Similarity and Diffusion Geometry
Discrete Geometry Tutorial 2 1
Discrete geometry Lecture 2 1 © Alexander & Michael Bronstein
1 Numerical geometry of non-rigid shapes Consistent approximation of geodesics in graphs Consistent approximation of geodesics in graphs Tutorial 3 © Alexander.
1 Processing & Analysis of Geometric Shapes Shortest path problems Shortest path problems The discrete way © Alexander & Michael Bronstein, ©
1 Michael Bronstein Computational metric geometry Computational metric geometry Michael Bronstein Department of Computer Science Technion – Israel Institute.
Asst. Prof. Yusuf Sahillioğlu
CENG 789 – Digital Geometry Processing 01- Introduction Asst. Prof. Yusuf Sahillioğlu Computer Eng. Dept,, Turkey.
CENG 789 – Digital Geometry Processing 05- Smoothing and Remeshing
Asst. Prof. Yusuf Sahillioğlu
CENG 789 – Digital Geometry Processing 06- Rigid-Body Alignment Asst. Prof. Yusuf Sahillioğlu Computer Eng. Dept,, Turkey.
Scale Normalization for Isometric Shape Matching Yusuf Sahillioğlu and Yücel Yemez Computer Eng. Dept., Koç University, Istanbul, Turkey.
Surface Reconstruction from 3D Volume Data. Problem Definition Construct polyhedral surfaces from regularly-sampled 3D digital volumes.
Numerical geometry of non-rigid shapes
1 Bronstein 2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes Michael M. Bronstein Department of Computer Science Technion – Israel Institute.
Correspondence & Symmetry
1 Numerical geometry of non-rigid shapes Spectral Methods Tutorial. Spectral Methods Tutorial 6 © Maks Ovsjanikov tosca.cs.technion.ac.il/book Numerical.
1 Numerical geometry of non-rigid shapes Lecture II – Numerical Tools Numerical geometry of shapes Lecture II – Numerical Tools non-rigid Alex Bronstein.
Numerical geometry of non-rigid shapes
1 Bronstein, Bronstein, and Kimmel Joint extrinsic and intrinsic similarity of non-rigid shapes Rock, paper, and scissors Joint extrinsic and intrinsic.
Jianke Zhu From Haibin Ling’s ICCV talk Fast Marching Method and Deformation Invariant Features.
reconstruction process, RANSAC, primitive shapes, alpha-shapes
1 Numerical geometry of non-rigid shapes A journey to non-rigid world objects Numerical methods non-rigid Alexander Bronstein Michael Bronstein Numerical.
Non-Euclidean Embedding
1 Numerical geometry of non-rigid shapes Numerical Geometry Numerical geometry of non-rigid shapes Numerical geometry Alexander Bronstein, Michael Bronstein,
Geometry of Infinite Graphs Jim Belk Bard College.
A Global Geometric Framework for Nonlinear Dimensionality Reduction Joshua B. Tenenbaum, Vin de Silva, John C. Langford Presented by Napat Triroj.
Geometric Approaches to Reconstructing Times Series Project Outline 15 February 2007 CSC/Math 870 Computational Discrete Geometry Connie Phong.
Atul Singh Junior Undergraduate CSE, IIT Kanpur.  Dimension reduction is a technique which is used to represent a high dimensional data in a more compact.
1 Numerical geometry of non-rigid shapes Non-Euclidean Embedding Non-Euclidean Embedding Lecture 6 © Alexander & Michael Bronstein tosca.cs.technion.ac.il/book.
Nonlinear Dimensionality Reduction Approaches. Dimensionality Reduction The goal: The meaningful low-dimensional structures hidden in their high-dimensional.
Introduction --Classification Shape ContourRegion Structural Syntactic Graph Tree Model-driven Data-driven Perimeter Compactness Eccentricity.
Manifold learning: Locally Linear Embedding Jieping Ye Department of Computer Science and Engineering Arizona State University
Algorithms for 3D Isometric Shape Correspondence Yusuf Sahillioğlu Computer Eng. Dept., Koç University, Istanbul, Turkey.
Final Exam Review CS485/685 Computer Vision Prof. Bebis.
Computing the shortest path on a polyhedral surface Presented by: Liu Gang
1 Numerical geometry of non-rigid shapes Shortest path problems Shortest path problems Lecture 2 © Alexander & Michael Bronstein tosca.cs.technion.ac.il/book.
4/15/04© University of Wisconsin, CS559 Spring 2004 Last Time More modeling: –Hierarchical modeling –Instancing and Parametric Instancing –Constructive.
Shape Matching for Model Alignment 3D Scan Matching and Registration, Part I ICCV 2005 Short Course Michael Kazhdan Johns Hopkins University.
EMANUELE RODOLÀ A Game-Theoretic Perspective on Registration and Recognition of 3D Shapes.
CS 551/651 Advanced Computer Graphics Warping and Morphing Spring 2002.
Algorithms for Triangulations of a 3D Point Set Géza Kós Computer and Automation Research Institute Hungarian Academy of Sciences Budapest, Kende u
Coarse-to-Fine Combinatorial Matching for Dense Isometric Shape Correspondence Yusuf Sahillioğlu and Yücel Yemez Computer Eng. Dept., Koç University, Istanbul,
ALIGNMENT OF 3D ARTICULATE SHAPES. Articulated registration Input: Two or more 3d point clouds (possibly with connectivity information) of an articulated.
An Efficient Approach to Clustering in Large Multimedia Databases with Noise Alexander Hinneburg and Daniel A. Keim.
Expression-invariant Face Recognition using Geodesic Distance Isometries Kerry Widder A Review of ‘Robust expression-invariant face recognition from partially.
A 3D Model Alignment and Retrieval System Ding-Yun Chen and Ming Ouhyoung.
Shape Analysis and Retrieval Structural Shape Descriptors Notes courtesy of Funk et al., SIGGRAPH 2004.
Haibin Ling and David Jacobs, Deformation Invariant Image Matching, ICCV, Oct. 20, 2005 Deformation Invariant Image Matching Haibin Ling and David W. Jacobs.
Graphs. Definitions A graph is two sets. A graph is two sets. –A set of nodes or vertices V –A set of edges E Edges connect nodes. Edges connect nodes.
Roee Litman, Alexander Bronstein, Michael Bronstein
Introduction --Classification Shape ContourRegion Structural Syntactic Graph Tree Model-driven Data-driven Perimeter Compactness Eccentricity.
Skuller: A volumetric shape registration algorithm for modeling skull deformities Yusuf Sahillioğlu 1 and Ladislav Kavan 2 Medical Image Analysis 2015.
Methods for 3D Shape Matching and Retrieval
CENG 789 – Digital Geometry Processing 06- Smoothing and Remeshing
A Part-aware Surface Metric for Shape Analysis Rong Liu 1, Hao Zhang 1, Ariel Shamir 2, and Daniel Cohen-Or 3 1 Simon Fraser University, Canada 2 The Interdisciplinary.
CENG 789 – Digital Geometry Processing 07- Rigid-Body Alignment Asst. Prof. Yusuf Sahillioğlu Computer Eng. Dept,, Turkey.
CENG 789 – Digital Geometry Processing 10- Data-Driven Shape Analysis
CENG 789 – Digital Geometry Processing 9- Least-Squares Solutions Asst. Prof. Yusuf Sahillioğlu Computer Eng. Dept,, Turkey.
Spectral Methods for Dimensionality

CENG 789 – Digital Geometry Processing 08- Rigid-Body Alignment
CENG 789 – Digital Geometry Processing 01- Introduction
Assoc. Prof. Yusuf Sahillioğlu
CENG 789 – Digital Geometry Processing 10- Least-Squares Solutions
CENG 789 – Digital Geometry Processing 09- Rigid-Body Alignment
CENG 789 – Digital Geometry Processing 11- Least-Squares Solutions
Presentation transcript:

CENG 789 – Digital Geometry Processing 04- Distances, Descriptors and Sampling on Meshes Asst. Prof. Yusuf Sahillioğlu Computer Eng. Dept,, Turkey

Distances 2 / 27 Euclidean vs. Geodesic distances. Euclidean geometry: Distance between 2 points is a line. Non-Euclidean geom: Distance between 2 points is a curvy path along the object surface. Geometry of the objects that we deal with is non-Euclidean. Same intrinsically, different extrinsically: We use intrinsic geometry to compare shapes as the understanding of a finger does not change when you bend your arm.

Geodesic Distance 3 / 27 Intrinsic geometry is defined by geodesic distances: length of the shortest (curvy) path (of edges) between two points.

Geodesic Distance 4 / 27 Compute with Dijkstra’s shortest path algorithm since the mesh is an undirected graph. v.d is the shortest-path estimate (from source s to v). v.pi is the predecessor of v. Q is a min-priority queue of vertices, keyed by their d values. S is a set of vertices whose final shortest paths from s is determined.

Geodesic Distance 5 / 27 The execution of Dijkstra’s algorithm (on a directed graph):

Geodesic Distance 6 / 27 Does the path really stay on the surface? Yes, but could have been better if it could go through faces. Euclidean distance Geodesic distance Geodesic on high-reso

Geodesic Distance 7 / 27 Does the path really stay on the surface? Yes, but could have been better if it could go through faces. Euclidean distance Geodesic distance

Geodesic Distance 8 / 27 Does the path really stay on the surface? Yes, but could have been better if it could go through faces. Try to add virtual (blue) edges if the 4 triangles involved are nearly co-planar.

Geodesic Distance 9 / 27 Fast marching algorithm for more flexible (and accurate) face travels. R. Kimmel and J. A. Sethian. Computing geodesic paths on manifolds, vs. Shortcut edge (blue on prev slide) allows face travel starting from a face vertex. Fast marching allows face travel starting from an arbitrary pnt on the face edge.

Geodesic Distance 10 / 27 Careful with topological noise.

Diffusion Distance 11 / 27 Principle: diffusion of heat after some time t. Geodesic: length of the shortest path. Diffusion: average over all path of length t.

Geodesic Distance 12 / 27 What can we do with this geodesic? Descriptor. Sampling. Similarity comparisons...

Shape Descriptors 13 / 27 Local (vertex-based) vs. Global (shape-based) shape descriptors. Desired properties: Automatic Fast to compute and compare Discriminative Invariant to transformations (rigid, non-rigid,..)

Shape Descriptors 14 / 27 A toy global descriptor: F = [x1, y1, z1, x2, y2, z2,.., xn, yn, zn]. Desired properties: Automatic?? Fast to compute and compare?? Discriminative?? Invariant to transformations (rigid, non-rigid,..)??

Shape Descriptors 15 / 27 A toy global descriptor: F = [numOfHandles]. //computable by Euler’s formula. Desired properties: Automatic?? Fast to compute and compare?? Discriminative?? Invariant to transformations (rigid, non-rigid,..)??

Shape Descriptors 16 / 27 Cooler global descriptors: shape histograms area/volume intersected by each region stored in a histogram indexed by radius

Shape Descriptors 17 / 27 Cooler global descriptors: shape distributions distance between 2 random points on the surface angle between 3 random points on the surface..

Shape Descriptors 18 / 27 Global descriptor to a local descriptor: center it about p.

Shape Descriptors 19 / 27 More local shape descriptors. Curvature Average Geodesic Distance Shape Diameter sum of geodesics from v to all other vertices. sum of ray lengths from v.

Sampling 20 / 27 Subset of vertices are sampled via Evenly-spaced Curvature-orientedFarthest-point sampling evenly-spaced sampling sampling FPS: Eldar et al., The farthest point strategy for progressive image sampling. Uniform sampling

Sampling 21 / 27 FPS idea. You have V vertices and N samples; want to sample the (N+1)st. V-N candidates. Each candidate is associated with the closest existing sample. Remember the distance used in this association. As your (N+1)st sample, pick the candidate that has the max remembered distance. O(N VlogV) complexity.

An Application: Shape Correspondence 22 / 27 Feature-based and/or distance-based algorithms for shape correspondence, an important problem in computer graphics.

An Application: Shape Correspondence 23 / 27 Feature-based: match the points with close feature descriptors. Pointwise term, i.e., involves 1 point at a time.

An Application: Shape Correspondence 24 / 27 Distance-based: match 2 points with compatible distances. Pairwise term, i.e., involves 2 points at a time. g g gg g g g g average for

An Application: Shape Correspondence 25 / 27 Feature- and distance-based: a combination of both.

An Application: Shape Correspondence 26 / 27 Interpolation of a sparse correspondence into a dense one. Compute for each vertex on M1 the geodesic distances to all sparse correspondence points on M1, and then establish a correspondence to the vertex on M2 with the most similar distances to sparse correspondence points on M2. Feature-based or distance-based?

Shape Embedding 27 / 27 Multidimensional Scaling: Dissimilarities, e.g., pairwise geodesic distances, are represented by Euclidean distances in R d. d = 2d=3d=3