Object Recognition. Geometric Task : find those rotations and translations of one of the point sets which produce “large” superimpositions of corresponding.

Slides:



Advertisements
Similar presentations
Object Recognition from Local Scale-Invariant Features David G. Lowe Presented by Ashley L. Kapron.
Advertisements

MOTION IN GEOMETRY: TRANSFORMATIONS
Medical Image Registration Kumar Rajamani. Registration Spatial transform that maps points from one image to corresponding points in another image.
PCA + SVD.
A 3-D reference frame can be uniquely defined by the ordered vertices of a non- degenerate triangle p1p1 p2p2 p3p3.
Intelligent Information Retrieval 1 Vector Space Model for IR: Implementation Notes CSC 575 Intelligent Information Retrieval These notes are based, in.
Seminar in structural bioinformatics Multiple structural alignment of proteins By Elad Kaspani.
Camera calibration and epipolar geometry
Protein Structure Alignment Human Myoglobin pdb:2mm1 Human Hemoglobin alpha-chain pdb:1jebA Sequence id: 27% Structural id: 90% Another example: G-Proteins:
Rational Trigonometry Applied to Robotics
Two Examples of Docking Algorithms With thanks to Maria Teresa Gil Lucientes.
Structural Bioinformatics Workshop Max Shatsky Workshop home page:
Docking Algorithm Scheme Part 1: Molecular shape representation Part 2: Matching of critical features Part 3: Filtering and scoring of candidate transformations.
Protein Structure, Databases and Structural Alignment
Department of Computer Science, University of California, Santa Barbara August 11-14, 2003 CTSS: A Robust and Efficient Method for Protein Structure Alignment.
Symmetric hash functions for fingerprint minutiae
2D/3D Geometric Transformations CS485/685 Computer Vision Dr. George Bebis.
Agenda A brief introduction The MASS algorithm The pairwise case Extension to the multiple case Experimental results.
Seminar in BioInformatics A Method for Biomolecular Structural Recognition and Docking Allowing Conformational Flexibility (1998) Bilha Sandak, Ruth Nussinov.
Largest Common Point Set (LCP) problem Given e>0 and two point sets A and B find a transformation T and equally sized subsets A’ (a subset of A) and B’
Epipolar geometry. (i)Correspondence geometry: Given an image point x in the first view, how does this constrain the position of the corresponding point.
Uncalibrated Geometry & Stratification Sastry and Yang
Finding Compact Structural Motifs Presented By: Xin Gao Authors: Jianbo Qian, Shuai Cheng Li, Dongbo Bu, Ming Li, and Jinbo Xu University of Waterloo,
FLEX* - REVIEW.
Multiple-view Reconstruction from Points and Lines
Structural Bioinformatics Workshop Max Shatsky Workshop home page:
Object Recognition Using Geometric Hashing
Previously Two view geometry: epipolar geometry Stereo vision: 3D reconstruction epipolar lines Baseline O O’ epipolar plane.
A unified statistical framework for sequence comparison and structure comparison Michael Levitt Mark Gerstein.
1 Alignment of Flexible Protein Structures Based on: FlexProt: Alignment of Flexible Protein Structures Without a Pre-definition of Hinge Regions / M.
Structural Bioinformatics Seminar Dina Schneidman
Improved Approximation Bounds for Planar Point Pattern Matching (under rigid motions) Minkyoung Cho Department of Computer Science University of Maryland.
COMP 290 Computer Vision - Spring Motion II - Estimation of Motion field / 3-D construction from motion Yongjik Kim.
May 2004Stereo1 Introduction to Computer Vision CS / ECE 181B Tuesday, May 11, 2004  Multiple view geometry and stereo  Handout #6 available (check with.
Automatic Image Alignment (feature-based) : Computational Photography Alexei Efros, CMU, Fall 2006 with a lot of slides stolen from Steve Seitz and.
1 Seminar in structural bioinformatics Pairwise Structural Alignment Presented by: Dana Tsukerman.
Protein Structure Prediction Samantha Chui Oct. 26, 2004.
Model Database. Scene Recognition Lamdan, Schwartz, Wolfson, “Geometric Hashing”,1988.
Geometric Hashing Visual Recognition Lecture 9 “Answer me speedily” Psalm, 17.
Protein Structure Alignment
Multi-view geometry. Multi-view geometry problems Structure: Given projections of the same 3D point in two or more images, compute the 3D coordinates.
1 Fingerprint Classification sections Fingerprint matching using transformation parameter clustering R. Germain et al, IEEE And Fingerprint Identification.
CSE554AlignmentSlide 1 CSE 554 Lecture 8: Alignment Fall 2014.
CSE554Laplacian DeformationSlide 1 CSE 554 Lecture 8: Laplacian Deformation Fall 2012.
Final Exam Review CS485/685 Computer Vision Prof. Bebis.
Chapter 9 Superposition and Dynamic Programming 1 Chapter 9 Superposition and dynamic programming Most methods for comparing structures use some sorts.
Epipolar geometry The fundamental matrix and the tensor
1 Preview At least two views are required to access the depth of a scene point and in turn to reconstruct scene structure Multiple views can be obtained.
CSE554AlignmentSlide 1 CSE 554 Lecture 5: Alignment Fall 2011.
Intelligent Vision Systems ENT 496 Object Shape Identification and Representation Hema C.R. Lecture 7.
视觉的三维运动理解 刘允才 上海交通大学 2002 年 11 月 16 日 Understanding 3D Motion from Images Yuncai Liu Shanghai Jiao Tong University November 16, 2002.
CSE554AlignmentSlide 1 CSE 554 Lecture 8: Alignment Fall 2013.
Affine Structure from Motion
Event retrieval in large video collections with circulant temporal encoding CVPR 2013 Oral.
Bart M. ter Haar Romeny.  Question: can top-points be used for object- retrieval tasks?
Geometric Hashing: A General and Efficient Model-Based Recognition Scheme Yehezkel Lamdan and Haim J. Wolfson ICCV 1988 Presented by Budi Purnomo Nov 23rd.
EECS 274 Computer Vision Affine Structure from Motion.
Course14 Dynamic Vision. Biological vision can cope with changing world Moving and changing objects Change illumination Change View-point.
Structural alignment methods Like in sequence alignment, try to find best correspondence: –Look at atoms –A 3-dimensional problem –No a priori knowledge.
Determining 3D Structure and Motion of Man-made Objects from Corners.
776 Computer Vision Jan-Michael Frahm Spring 2012.
Introduction to Scale Space and Deep Structure. Importance of Scale Painting by Dali Objects exist at certain ranges of scale. It is not known a priory.
Instructor: Mircea Nicolescu Lecture 9
Find the optimal alignment ? +. Optimal Alignment Find the highest number of atoms aligned with the lowest RMSD (Root Mean Squared Deviation) Find a balance.
CSE 554 Lecture 8: Alignment
René Vidal and Xiaodong Fan Center for Imaging Science
Application: Geometric Hashing
Geometric Hashing: An Overview
Finding Functionally Significant Structural Motifs in Proteins
Protein Structure Alignment
Presentation transcript:

Object Recognition

Geometric Task : find those rotations and translations of one of the point sets which produce “large” superimpositions of corresponding 3-D points. Given two configurations of points in the three dimensional space, T

Geometric Task (continued) Aspects: Object representation (points, vectors, segments) Object resemblance (distance function) Transformation (translations, rotations, scaling)

Transformations Translation Translation and Rotation Rigid Motion (Euclidian Trans.) Translation, Rotation + Scaling

Distance Functions Two point sets: A={a i } i=1…n B={b j } j=1…m Pairwise Correspondence: (a k 1,b t 1 ) (a k 2,b t 2 )… (a k N,b t N ) (1) Exact Matching: ||a k i – b t i ||=0 (2) RMSD (Root Mean Square Distance) Sqrt( Σ||a k i – b t i || 2 /N) < ε Hausdorff distance: h(A,B)=max aєA min bєB ||a– b|| H(A,B)=max( h(A,B), h(B,A))

Exact Point Matching in R 2 1.Determine the centroids C A,C B (i.e. arithmetic means) of the sets A and B. 2. Determine the polar coordinates of all points in A using C A as the origin. Then sort A lexicographically with respect to these polar coordinates (angle,length) obtaining a sequence (φ 1,r 1 )…(φ n,r n ). Let S A =(ψ 1,r 1 )…(ψ n,r n ), where ψ i = φ i mode n – φ i-1. Compute in the same way the correspondence sequence S B of the set B. 3. Determine whether S B is a cyclic shift of S A (i.e. S B is a substring of S A S A ). O(n log n)

Approximate Matching in R 2, R 3 (Hausdorff distance) E- Euclidian motion (translation and rotation), |A|=m, |B|=n 1.Select from A diametrically opposing points r and k. O(m log(m)) 2.For each r` from B define T r` – translation that takes r to r`. 3.For each k` (k`!=r`) define R k` – rotation around r that makes r,k`,k collinear. 4.Let E r`k` = R k` T r`. Let E`, h(E`(A),B)=min r`k` h(E r`k` (A),B). h(E`(A),B) <= 4*h(E opt (A),B) O(n 2 mlog 2 (n)) R 3 : h(E`(A),B) <= 8*h(E opt (A),B) O(n 3 mlog 2 (n)) M.T. Goodrich, J.S.B. Mitchell, M.W. Orletsky

Superposition - best least squares (RMSD) rigid alignment Given two sets of 3-D points : P={p i }, Q={q i }, i=1,…,n; find a 3-D rotation R 0 and translation T 0, such that min R,T  i |Rp i + T - q i | 2 =  i |R 0 p i + T 0 - q i | 2. A closed form solution exists for this task. It can be computed in O(n) time.

Model Database

Scene

Recognition Lamdan, Schwartz, Wolfson, “Geometric Hashing”,1988.

Geometric Matching task = Geometric Pattern Discovery

Remarks : The superimposition pattern is not known a- priori – pattern discovery. The matching recovered can be inexact. We are looking not necessarily for the largest superimposition, since other matchings may have biological meaning.

Straightforward Algorithm For each pair of triplets, one from each molecule which define ‘almost’ congruent triangles compute the rigid motion that superimposes them. Count the number of point pairs, which are ‘almost’ superimposed and sort the hypotheses by this number.

Naive algorithm (continued ) For the highest ranking hypotheses improve the transformation by replacing it by the best RMSD transformation for all the matching pairs. Complexity : assuming order of n points in both molecules - O(n 7 ). (O(n 3 ) if one exploits protein backbone geometry.)

Geometric Hashing - Preprocessing Pick a reference frame satisfying pre-specified constraints. Compute the coordinates of all the other points (in a pre-specified neighborhood) in this reference frame. Use each coordinate as an address to the hash (look-up) table and record in that entry the (ref. frame, shape sign.,point). Repeat above steps for each reference frame.

Geometric Hashing - Recognition 1 For the target protein do : Pick a reference frame satisfying pre-specified constraints. Compute the coordinates of all other points in the current reference frame. Use each coordinate to access the hash-table to retrieve all the records (ref.fr., shape sign., pt.).

Geometric Hashing - Recognition 2 For records with matching shape sign. “vote” for the (ref.fr.). Compute the transformations of the “high scoring” hypotheses. Repeat the above steps for each ref.fr. Cluster similar transformation. Extend best matches.

A 3-D reference frame can be uniquely defined by the ordered vertices of a non-degenerate triangle p1p1 p2p2 p3p3

Complexity of Geometric Hashing O(n 4 + n 4 * BinSize) ~ O(n 5 ) (Naive alg. O(n 7 ))

Advantages : Sequence order independent. Can match partial disconnected substructures. Pattern detection and recognition. Highly efficient. Can be applied to protein-protein interfaces, surface motif detection, docking. Database Object Recognition – a trivial extension to the method Parallel Implementation – straight forward

Structural Comparison Algorithms C  backbone matching. Secondary structure configuration matching. Molecular surface matching. Multiple Structure Alignment. Flexible (Hinge - based) structural alignment.

Protein Structural Comparison FeatureExtraction Verification and Scoring CC Backbone Secondary Structures H-bonds Geometric Hashing Flexible Geometric Hashing Least Square Analysis Transformation Clustering Sequence Dependent Weights PDB files Other Inputs Rotation and Translation Possibilities GeometricMatching

Problems Redundancy in representation Solution: clustering Numerical Stability Solution: add geometrical constraints Accuracy is not always “the best policy” Always compute in a give error threshold Consistency of Solution