Presentation is loading. Please wait.

Presentation is loading. Please wait.

Flexible Camera Calibration by Viewing a Plane from Unknown Orientations Zhengyou Zhang Vision Technology Group Microsoft Research.

Similar presentations


Presentation on theme: "Flexible Camera Calibration by Viewing a Plane from Unknown Orientations Zhengyou Zhang Vision Technology Group Microsoft Research."— Presentation transcript:

1 Flexible Camera Calibration by Viewing a Plane from Unknown Orientations Zhengyou Zhang Vision Technology Group Microsoft Research

2 Problem Statement u Determine the characteristics of a camera (focal length, aspect ratio, principal point) from visual information (images)

3 Motivations u Recovery of 3D Euclidean structure from images is essential for many applications. u This requires camera calibration. u Look for a flexible and robust technique, suitable for desktop vision systems. (such that it can be used by the general public)

4 Classical Approach (Photogrammetry) u Use precisely known 3D points u Shortcomings: Not flexible –very expensive to make such a calibration apparatus. Known displacement

5 Futuristic Approach (Self-calibration) u Shortcoming: Not always reliable –too many parameters to estimate u Move the camera in a static environment –match feature points across images –make use of rigidity constraint

6 Realistic Approach (my new method) u Use only one plane –Print a pattern on a paper –Attach the paper on a planar surface –Show the plane freely a few times to the camera u Advantages: –Flexible! –Robust? Yes. See RESULTS

7 Camera Model C m

8 C Plane projection u The relation between image points and model points is then given by: with m u For convenience, assume the plane at z = 0.

9 What do we get from one image? u We can obtain two equations in 6 intermediate homogeneous parameters. Given H, which is defined up to a scale factor, And let, we have This yields

10 Geometric interpretation Plane at infinity Absolute conic C

11 Linear Equations u Let u Define up to a scale factor up to a scale factor u Rewrite as linear equations: as linear equations: symmetric

12 What do we get from 2 images? u If we impose = 0, which is usually the case with modern cameras, we can solve all the other camera intrinsic parameters. How about more images? Better! More constraints than unknowns.

13 Solution u Show the plane under n different orientations (n > 1) u Estimate the n homography matrices (analytic solution followed by MLE) u Solve analytically the 6 intermediate parameters (defined up to a scale factor) u Extract the five intrinsic parameters u Compute the extrinsic parameters u Refine all parameters with MLE

14 Experimental results

15 Extracted corner points

16 Result (1)

17 Result (2)

18 Correction of Radial Distortion Corrected image Original image

19 Errors vs. Noise Levels in data

20 Errors vs. Number of Planes

21 Errors vs. Angle of the plane

22 Errors vs. Noise in model points

23 Errors vs. Spherical non-planarity

24 Errors vs. Cylindrical non-planarity

25 Application to object modeling

26 Reconstructed VRML Model

27 Conclusion u We have developed a flexible and robust technique for camera calibration. u Analytical solution exists. u MLE improves the analytical solution. u We need at least two images if c = 0. u We can use as many images of the plane as possible to improve the accuracy.

28 It really works! u Currently used routinely in both Vision and Graphics Groups. u Binary executable will be distributed on the Web to the public soon. u Source code will also be made available.


Download ppt "Flexible Camera Calibration by Viewing a Plane from Unknown Orientations Zhengyou Zhang Vision Technology Group Microsoft Research."

Similar presentations


Ads by Google