Download presentation

Presentation is loading. Please wait.

Published byNickolas Lloyd Modified over 4 years ago

1
CSE 6367 Computer Vision Stereo Reconstruction Camera Coordinate Transformations “Everything should be made as simple as possible, but not simpler.” Albert Einstein Farhad Kamangar Computer Science and Engineering Department The University of Texas at Arlington

2
Stereo Constraints (Review) p p’ ? Given p in left image, find the corresponding point p’ in right image be?

3
Stereo X1X1 Y1Y1 Z1Z1 O1O1 Image plane Focal plane P p p’ Y2Y2 X2X2 Z2Z2 O2O2 Epipolar Line Epipole

4
Stereo X1X1 Y1Y1 Z1Z1 O1O1 Image plane Focal plane P p p’ Y2Y2 X2X2 Z2Z2 O2O2 Epipolar Line Epipole All epipolar lines pass through the epipole

5
Stereo X1X1 Y1Y1 Z1Z1 O1O1 Image plane Focal plane P p p’ Y2Y2 X2X2 Z2Z2 O2O2 Epipolar Line Epipole All epipolar lines pass through the epipole

6
Stereo X1X1 Y1Y1 Z1Z1 O1O1 Image plane Focal plane P p p’ Y2Y2 X2X2 Z2Z2 O2O2 Epipolar Line Epipole T

7
Stereo X1X1 Y1Y1 Z1Z1 O1O1 Image plane Focal plane P p p’ Y2Y2 X2X2 Z2Z2 O2O2 Epipolar Line Epipole T

8
Stereo X1X1 Y1Y1 Z1Z1 O1O1 Image plane Focal plane P p p’ Y2Y2 X2X2 Z2Z2 O2O2 Epipolar Line Epipole T T=O 2 -O 1 O1, O2, p, and p’ are on the same plane

9
Stereo X1X1 Y1Y1 Z1Z1 O1O1 Image plane Focal plane P p p’ Y2Y2 X2X2 Z2Z2 O2O2 Epipolar Line Epipole T O1, O2, p, and p’ are on the same plane

10
Stereo X1X1 Y1Y1 Z1Z1 O1O1 Image plane Focal plane P p p’ Y2Y2 X2X2 Z2Z2 O2O2 Epipolar Line Epipole T E is Essential matrix

11
The Essential Matrix U and v are the coordinates of point p in image plane Equation of epipolar line which corresponds to point p

12
The Essential Matrix Essential Matrix: Based on the Relative Geometry of the Cameras Cameras are assumed to be calibrated Has five independent parameters

13
Fundamental Matrix Assuming that the image coordinates of points p and p’ are u and u’ F is the fundamental matrix

14
Fundamental Matrix Fundamental Matrix, F, is a 3 by 3 matrix (singular with rank 2) F has 7 parameters up to scale and can be estimated from 7 point correspondences Direct Simpler Method requires 8 correspondences

15
Estimating Fundamental Matrix

16
The 8-point Algorithm

17
Camera Parameters Assume a camera (any camera) where the Projection Reference Point ( PRP ), is located at: Normal vector to the projection plane (View Plane Normal VPN) is given as: The View Up (VUP) vector is given as:

18
Transform Camera to World The general form of the matrix that transforms the camera coordinate system to the world coordinate system is,

19
Two Cameras Now assume we have two cameras, left camera and right camera For left camera: For right camera:

20
Point in the World Assume a point in the homogenous world coordinate system:

21
The coordinates of this point in the left camera coordinate system is: The coordinates of this point in the right camera coordinate system is:

22
Left Camera to World The matrix that transforms the left camera coordinate system to the world coordinate system

23
Right Camera to World The matrix that transforms the right camera coordinate system to the world coordinate system

24
Right Camera to Left Camera The matrix that transforms the right camera coordinate system to the left camera coordinate system

25
Given point P in the world coordinate system, the coordinate of this point in the left camera coordinate system will be:

26
Assuming that the focal length of the camera is f, Assume that the image of the point P on the left image plane is P’. The coordinate of the point P’ in the left camera coordinate system will be:

27
Assume that the image of the point P on the right image plane is P’’. The coordinate of the point P’’ in the right camera coordinate system will be:

28
Problem: given all the camera parameters and only the x and y coordinates of the points P’ and P’’, find the coordinates of the point P in the world coordinate system. In other words; given the projections of the point P on the left and right image planes, find the coordinates of the original point P.

29
From Left Camera to Right Camera

30
Calculate Camera Coordinates (1)

31
Calculate Camera Coordinates (2)

32
Calculate Camera Coordinates (3)

Similar presentations

© 2019 SlidePlayer.com Inc.

All rights reserved.

To make this website work, we log user data and share it with processors. To use this website, you must agree to our Privacy Policy, including cookie policy.

Ads by Google