Presentation is loading. Please wait.

Presentation is loading. Please wait.

Lec 21: Fundamental Matrix

Similar presentations


Presentation on theme: "Lec 21: Fundamental Matrix"— Presentation transcript:

1 Lec 21: Fundamental Matrix
CS4670 / 5670: Computer Vision Kavita Bala Lec 21: Fundamental Matrix

2 Readings Szeliski, Chapter 7.2 “Fundamental matrix song”

3 3d point lies somewhere along r
Two-view geometry Where do epipolar lines come from? 3d point lies somewhere along r epipolar plane epipolar line epipolar line (projection of r) Image 1 Image 2

4 Fundamental matrix epipolar plane epipolar line epipolar line (projection of ray) Image 1 Image 2 This epipolar geometry of two views is described by a Very Special 3x3 matrix , called the fundamental matrix maps (homogeneous) points in image 1 to lines in image 2! The epipolar line (in image 2) of point p is: Epipolar constraint on corresponding points:

5 Fundamental matrix Two special points: e1 and e2 (the epipoles): projection of one camera into the other All of the epipolar lines in an image pass through the epipole

6 Fundamental matrix Why does F exist? Let’s derive it…

7 Fundamental matrix : intrinsics of camera 2 : intrinsics of camera 1
: intrinsics of camera 1 : intrinsics of camera 2 [x y w] = Projection K_1 [X Y Z 1] = [Xf Yf Z] Consider a ray through p. It goes through p and the point at infinity along that ray. : rotation of image 2 w.r.t. camera 1 : ray through p in camera 1’s (and world) coordinate system : ray through q in camera 2’s coordinate system

8 Fundamental matrix , , and are coplanar
, , and are coplanar epipolar plane can be represented as X^T l = 0 for a point on the line. Use that in the equation

9 Fundamental matrix

10 Cross-product as linear operator
Useful fact: Cross product with a vector t can be represented as multiplication with a (skew-symmetric) 3x3 matrix

11 Fundamental matrix

12 Fundamental matrix { the Essential matrix

13 Fundamental matrix the Fundamental matrix

14 Fundamental matrix the Fundamental matrix : intrinsics of camera 1
: intrinsics of camera 1 : intrinsics of camera 2 : rotation of image 2 w.r.t. camera 1 the Fundamental matrix

15 Fundamental matrix result

16 Properties of the Fundamental Matrix
is the epipolar line associated with T 5 parameters

17 Properties of the Fundamental Matrix
is the epipolar line associated with and All epipolar lines contain epipole T 5 parameters

18 Properties of the Fundamental Matrix
is the epipolar line associated with and is rank 2 T Prove that F is rank 2. F

19 Rectified case Prove that this results in the right: y1 = y2

20 Stereo image rectification
reproject image planes onto a common plane parallel to the line between optical centers pixel motion is horizontal after this transformation two homographies (3x3 transform), one for each input image reprojection C. Loop and Z. Zhang. Computing Rectifying Homographies for Stereo Vision. IEEE Conf. Computer Vision and Pattern Recognition, 1999.

21 Original stereo pair After rectification

22 Questions?

23 Alternative Formulation

24 Homogeneous notation for lines

25 The line l through the two points p and q is l = p x q
Proof The intersection of two lines l and m is the point x = l x m

26 Algebraic representation of epipolar geometry
We know that the epipolar geometry defines a mapping x l/ point in first image epipolar line in second image

27 Derivation of the algebraic expression
Outline Step 1: for a point x in the first image back project a ray with camera P P/ Step 2: choose two points on the ray and project into the second image with camera P/ Step 3: compute the line through the two image points using the relation l/ = p x q

28 from world to camera coordinate frame
choose camera matrices internal calibration rotation translation from world to camera coordinate frame first camera world coordinate frame aligned with first camera second camera

29 Step 1: for a point x in the first image back project a ray with camera
A point x back projects to a ray where Z is the point’s depth, since satisfies

30 P/ Step 2: choose two points on the ray and project into the second image with camera P/ Consider two points on the ray Z = 0 is the camera centre Z = is the point at infinity Project these two points into the second view

31 Step 3: compute the line through the two image points using the relation l/ = p x q
Compute the line through the points Using the identity F is the fundamental matrix F


Download ppt "Lec 21: Fundamental Matrix"

Similar presentations


Ads by Google