3D Scan Alignment Using ICP

Slides:



Advertisements
Similar presentations
Automatic 3D modeling from range images Daniel Huber Carnegie Mellon University Robotics Institute.
Advertisements

Partial and Approximate Symmetry Detection for 3D Geometry Mark Pauly Niloy J. Mitra Leonidas J. Guibas.
Feature Matching and Robust Fitting Computer Vision CS 143, Brown James Hays Acknowledgment: Many slides from Derek Hoiem and Grauman&Leibe 2008 AAAI Tutorial.
PCA + SVD.
Robust Global Registration Natasha Gelfand Niloy Mitra Leonidas Guibas Helmut Pottmann.
Model base human pose tracking. Papers Real-Time Human Pose Tracking from Range Data Simultaneous Shape and Pose Adaption of Articulated Models using.
Automatic in vivo Microscopy Video Mining for Leukocytes * Chengcui Zhang, Wei-Bang Chen, Lin Yang, Xin Chen, John K. Johnstone.
Implementation of ICP Variants Pavan Ram Piratla Janani Venkateswaran.
Instructor: Mircea Nicolescu Lecture 13 CS 485 / 685 Computer Vision.
Semi-automatic Range to Range Registration: A Feature-based Method Chao Chen & Ioannis Stamos Computer Science Department Graduate Center, Hunter College.
Reverse Engineering Niloy J. Mitra.
Registration of two scanned range images using k-d tree accelerated ICP algorithm By Xiaodong Yan Dec
CMPT-884 Jan 18, 2010 Video Copy Detection using Hadoop Presented by: Cameron Harvey Naghmeh Khodabakhshi CMPT 820 December 2, 2010.
Mesh Alignment Algorithms General and the Craniofacial Standard 1.
CENG 789 – Digital Geometry Processing 06- Rigid-Body Alignment Asst. Prof. Yusuf Sahillioğlu Computer Eng. Dept,, Turkey.
Final Class: Range Data registration CISC4/689 Credits: Tel-Aviv University.
Iterative closest point algorithms
Speed and Robustness in 3D Model Registration Szymon Rusinkiewicz Princeton University.
1 GEOMETRIE Geometrie in der Technik H. Pottmann TU Wien SS 2007.
1 Bronstein 2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes Michael M. Bronstein Department of Computer Science Technion – Israel Institute.
Scan Matching Pieter Abbeel UC Berkeley EECS
Efficient Variants of the ICP Algorithm
Correspondence & Symmetry
Detecting and Tracking Moving Objects for Video Surveillance Isaac Cohen and Gerard Medioni University of Southern California.
A Laser Range Scanner Designed for Minimum Calibration Complexity James Davis, Xing Chen Stanford Computer Graphics Laboratory 3D Digital Imaging and Modeling.
CS CS 175 – Week 2 Processing Point Clouds Registration.
Niloy J. Mitra1, Natasha Gelfand1, Helmut Pottmann2, Leonidas J
Matching and Recognition in 3D. Moving from 2D to 3D Some things harderSome things harder – Rigid transform has 6 degrees of freedom vs. 3 – No natural.
Scale Invariant Feature Transform (SIFT)
3D Shape Registration using Regularized Medial Scaffolds Ming-Ching Chang Frederic F. Leymarie Benjamin B. Kimia LEMS, Division of Engineering, Brown University.
3D reconstruction Class 16. 3D photography course schedule Introduction Aug 24, 26(no course) Aug.31,Sep.2(no course) Sep. 7, 9(no course) Sep. 14, 16Projective.
3D full object reconstruction from kinect Yoni Choukroun Elie Semmel Advisor: Yonathan Afflalo.
Linear Discriminant Functions Chapter 5 (Duda et al.)
A Hierarchical Method for Aligning Warped Meshes Leslie Ikemoto 1, Natasha Gelfand 2, Marc Levoy 2 1 UC Berkeley, formerly Stanford 2 Stanford University.
Iterative Closest Point Ronen Gvili. The Problem Align two partially- overlapping meshes given initial guess for relative transform.
Robust Statistical Estimation of Curvature on Discretized Surfaces Evangelos Kalogerakis Patricio Simari Derek Nowrouzezahrai Karan Singh Symposium on.
Accurate, Dense and Robust Multi-View Stereopsis Yasutaka Furukawa and Jean Ponce Presented by Rahul Garg and Ryan Kaminsky.
CSci 6971: Image Registration Lecture 16: View-Based Registration March 16, 2004 Prof. Chuck Stewart, RPI Dr. Luis Ibanez, Kitware Prof. Chuck Stewart,
3D Global Registration. The Problem Given: n scans around an objectGiven: n scans around an object Goal: align them allGoal: align them all First attempt:
Yuping Lin and Gérard Medioni.  Introduction  Method  Register UAV streams to a global reference image ▪ Consecutive UAV image registration ▪ UAV to.
CSE 185 Introduction to Computer Vision
Exploiting Segmentation for Robust 3D Object Matching Michael Krainin, Kurt Konolige, and Dieter Fox.
Automatic Registration of Color Images to 3D Geometry Computer Graphics International 2009 Yunzhen Li and Kok-Lim Low School of Computing National University.
Fitting and Registration Computer Vision CS 543 / ECE 549 University of Illinois Derek Hoiem 02/14/12.
Shape Matching for Model Alignment 3D Scan Matching and Registration, Part I ICCV 2005 Short Course Michael Kazhdan Johns Hopkins University.
CSE554AlignmentSlide 1 CSE 554 Lecture 5: Alignment Fall 2011.
A Method for Registration of 3D Surfaces ICP Algorithm
Realtime 3D model construction with Microsoft Kinect and an NVIDIA Kepler laptop GPU Paul Caheny MSc in HPC 2011/2012 Project Preparation Presentation.
EFFICIENT VARIANTS OF THE ICP ALGORITHM
Using simplified meshes for crude registration of two partially overlapping range images Mercedes R.G.Márquez Wu Shin-Ting State University of Matogrosso.
CSE 185 Introduction to Computer Vision Feature Matching.
Mesh Resampling Wolfgang Knoll, Reinhard Russ, Cornelia Hasil 1 Institute of Computer Graphics and Algorithms Vienna University of Technology.
Matlab Demo Feature Matching SIFT Source
CENG 789 – Digital Geometry Processing 07- Rigid-Body Alignment Asst. Prof. Yusuf Sahillioğlu Computer Eng. Dept,, Turkey.
Registration and Alignment Speaker: Liuyu
David Belton and Geoff West CRC for Spatial Information Department of Spatial Sciences Curtin University 1.
Linear Discriminant Functions Chapter 5 (Duda et al.) CS479/679 Pattern Recognition Dr. George Bebis.
CENG 789 – Digital Geometry Processing 08- Rigid-Body Alignment
MIRA, SVM, k-NN Lirong Xia. MIRA, SVM, k-NN Lirong Xia.
CS4670 / 5670: Computer Vision Kavita Bala Lec 27: Stereo.
Data Mining K-means Algorithm
Iterative Closest Point
Geometrically Stable Sampling for the ICP Algorithm
Dongwook Kim, Beomjun Kim, Taeyoung Chung, and Kyongsu Yi
The SIFT (Scale Invariant Feature Transform) Detector and Descriptor
Image Registration 박성진.
Real-time Acquisition and Rendering of Large 3D Models
CENG 789 – Digital Geometry Processing 09- Rigid-Body Alignment
CSE 185 Introduction to Computer Vision
MIRA, SVM, k-NN Lirong Xia. MIRA, SVM, k-NN Lirong Xia.
Presentation transcript:

3D Scan Alignment Using ICP

Problem Align two partially- overlapping meshes given initial guess for relative transform

Aligning 3D Data If correct correspondences are known, can find correct relative rotation/translation

Aligning 3D Data How to find correspondences: User input? Feature detection? Signatures? Alternative: assume closest points correspond

Aligning 3D Data … and iterate to find alignment Iterative Closest Points (ICP) [Besl & McKay 92] Converges if starting position “close enough“

ICP Variants Variants on the following stages of ICP have been proposed: Selecting source points (from one or both meshes) Matching to points in the other mesh Weighting the correspondences Rejecting certain (outlier) point pairs Assigning an error metric to the current transform Minimizing the error metric w.r.t. transformation

Performance of Variants Can analyze various aspects of performance: Speed Stability Tolerance of noise and/or outliers Maximum initial misalignment Comparisons of many variants in [Rusinkiewicz & Levoy, 3DIM 2001]

ICP Variants Selecting source points (from one or both meshes) Matching to points in the other mesh Weighting the correspondences Rejecting certain (outlier) point pairs Assigning an error metric to the current transform Minimizing the error metric w.r.t. transformation

Closest Compatible Point Closest point often a bad approximation to corresponding point Can improve matching effectiveness by restricting match to compatible points Compatibility of colors [Godin et al. 94] Compatibility of normals [Pulli 99] Other possibilities: curvatures, higher-order derivatives, and other local features

ICP Variants Selecting source points (from one or both meshes) Matching to points in the other mesh Weighting the correspondences Rejecting certain (outlier) point pairs Assigning an error metric to the current transform Minimizing the error metric w.r.t. transformation

Point-to-Plane Error Metric Using point-to-plane distance instead of point-to-point lets flat regions slide along each other [Chen & Medioni 91]

Demo