CSE 803 Stockman Fall Stereo models Algebraic models for stereo

CSE 803 Stockman Fall General stereo environment A world point P seen by two cameras must lie at the intersection of two rays in space. (The algebraic model is 4 linear equations in the 3 unknowns x,y,z, enabling solution for x,y,z.) It is also common to use 3 cameras; the reason will be seen later on.

CSE 803 Stockman Fall Baseline stereo: carefully aligned cameras

CSE 803 Stockman Fall Computing (x, y, z) in 3D from corresponding 2D image points

CSE 803 Stockman Fall calibrated cameras view the same 3D point at (r1,c1)(r2,c2)

CSE 803 Stockman Fall Compute closest approach of the two rays: use center point V Shortest line segment between rays

CSE 803 Stockman Fall Connector is perpendicular to both imaging rays

CSE 803 Stockman Fall Geometric interpretation Create a plane perpendicular to ray P; it can slide along the ray. All lines normal to ray P are in this plane. Create a plane perpendicular to ray Q; it can slide along the ray. All normals to ray Q are in this plane. Slide the planes and find that shortest line segment simultaneously in both planes.

CSE 803 Stockman Fall Solve for the endpoints of the connector Scaler mult. Fix book

CSE 803 Stockman Fall How to find points Pj and Qj ? We assume ray P originates at some fixed image point [r, c]. The camra matrix is known. Ray P is defined by 2 linear equations in 3 unknowns [ W Px, W Py, W P Z ] Create a plane perpendicular to ray P; it can slide along the ray. Pick some plane, say W P Z = 20 and solve for the other two 3D coordinates where the ray P pierces this plane. Make sure that the ray is not parallel to the picked plane! Repeat this process to get two points on ray P and two points on ray Q; making sure to use the second camera matrix and second image point for Q.

CSE 803 Stockman Fall Correspondence problem is most difficult aspect Can use interest points and cross correlation Can limit search to epipolar line Can use symbolic matching (Ch 11) to determine corresponding points (called structural stereopsis) apparently humans don’t need ss

CSE 803 Stockman Fall Epipolar constraint With aligned cameras, search for corresponding point is 1D along corresponding row of other camera. So, the match for P1 in image I2 must be along a given row.

CSE 803 Stockman Fall Epipolar constraint for non baseline stereo computation If cameras are not aligned, a 1D search can still be determined for the corresponding point. P1, C1, C2 determine a plane that cuts image I2 in a line: P2 will be on that line. Need to know relative orientation of cameras C1 and C2

CSE 803 Stockman Fall Measuring driver body position 4 cameras were used to measure driver position and posture while driving: 2mm accuracy achieved