Universität Hannover Institut für Photogrammetrie und GeoInformation Issues and Method for In-Flight and On-Orbit Calibration (only geometry) Karsten Jacobsen.

Slides:



Advertisements
Similar presentations
Geometric Analysis of DMC II140
Advertisements

Zhengyou Zhang Vision Technology Group Microsoft Research
Photogrammetry 1 1.
Aerial Photography and Photogrammetry
Geometry of Aerial Photographs
Computer Vision, Robert Pless
Bundle Block Adjustments in the practical Close Range applications Filippo Campolo Vincenzo Barrile University of Reggio Calabria Italy Racurs Conference,
Last 4 lectures Camera Structure HDR Image Filtering Image Transform.
Institut für Elektrische Meßtechnik und Meßsignalverarbeitung Professor Horst Cerjak, Augmented Reality VU 2 Calibration Axel Pinz.
Technical assistance from Republic of Latvia offered to Iraq in the field of architectural sites documentation by photogrammetrical methods Mr. G.Goldbergs.
Digital Camera and Computer Vision Laboratory Department of Computer Science and Information Engineering National Taiwan University, Taipei, Taiwan, R.O.C.
Computer vision: models, learning and inference
Camera Calibration. Issues: what are intrinsic parameters of the camera? what is the camera matrix? (intrinsic+extrinsic) General strategy: view calibration.
P.1 JAMES S. Bethel Wonjo Jung Geomatics Engineering School of Civil Engineering Purdue University APR Sensor Modeling and Triangulation for an.
Camera Models A camera is a mapping between the 3D world and a 2D image The principal camera of interest is central projection.
Geometry of Images Pinhole camera, projection A taste of projective geometry Two view geometry:  Homography  Epipolar geometry, the essential matrix.
MSU CSE 240 Fall 2003 Stockman CV: 3D to 2D mathematics Perspective transformation; camera calibration; stereo computation; and more.
CS485/685 Computer Vision Prof. George Bebis
Computing motion between images
Camera model Relation between pixels and rays in space ?
Multiple View Geometry Marc Pollefeys University of North Carolina at Chapel Hill Modified by Philippos Mordohai.
Single-view geometry Odilon Redon, Cyclops, 1914.
Multiple View Geometry Marc Pollefeys University of North Carolina at Chapel Hill Modified by Philippos Mordohai.
Camera parameters Extrinisic parameters define location and orientation of camera reference frame with respect to world frame Intrinsic parameters define.
Camera Calibration class 9 Multiple View Geometry Comp Marc Pollefeys.
Today: Calibration What are the camera parameters?
PHOTOGRAMMETRY an introduction…
Computer Vision Spring ,-685 Instructor: S. Narasimhan Wean 5403 T-R 3:00pm – 4:20pm Lecture #15.
Experimental aerial photogrammetry with professional non metric camera Canon EOS 5D Galileo Geo Sustavi Ante Sladojević, Goran Mrvoš.
CSC 589 Lecture 22 Image Alignment and least square methods Bei Xiao American University April 13.
Image Formation. Input - Digital Images Intensity Images – encoding of light intensity Range Images – encoding of shape and distance They are both a 2-D.
Remote Sensing and Image Processing PDF Aerial Photography and Photogrammetry.
WASET Defence, Computer Vision Theory and Application, Venice 13 th August – 14 th August 2015 A Four-Step Ortho-Rectification Procedure for Geo- Referencing.
776 Computer Vision Jan-Michael Frahm Fall Camera.
Camera Calibration class 9 Multiple View Geometry Comp Marc Pollefeys.
Geometric Camera Models and Camera Calibration
Course 12 Calibration. 1.Introduction In theoretic discussions, we have assumed: Camera is located at the origin of coordinate system of scene.
An Introduction to Mobile Robotics CSE350/ Sensor Systems (Continued) 2 Sep 03.
Remote Sensing Geometry of Aerial Photographs
Imaging Geometry for the Pinhole Camera Outline: Motivation |The pinhole camera.
SS5305 – Motion Capture Initialization 1. Objectives Camera Setup Data Capture using a Single Camera Data Capture using two Cameras Calibration Calibration.
Integration of sensors for photogrammetry and remote sensing 8 th semester, MS 2005.
Photogrammetry for Large Structures M. Kesteven CASS, CSIRO From Antikythera to the SKA Kerastari Workshop, June
CS654: Digital Image Analysis Lecture 8: Stereo Imaging.
CSCE 643 Computer Vision: Structure from Motion
Aerial Photography.
Principles of Photogrammetry: Stereoscopic Parallax
Introduction to the Principles of Aerial Photography
Camera Model & Camera Calibration
Geometric Camera Models
3D Photorealistic Modeling Process. Different Sensors Scanners Local coordinate system Cameras Local camera coordinate system GPS Global coordinate system.
Introduction to Soft Copy Photogrammetry
Various camera configurations Single point of fixation where optical axes intersect Optical axes parallel (fixation at infinity) General case.
October 5, Memorial University of Newfoundland Camera Calibration In the field of machine vision, camera calibration refers to the experimental.
1 Chapter 2: Geometric Camera Models Objective: Formulate the geometrical relationships between image and scene measurements Scene: a 3-D function, g(x,y,z)
Feature Matching. Feature Space Outlier Rejection.
Computer vision: models, learning and inference M Ahad Multiple Cameras
Stereo on PC. WE CAN OBSERVE THAT THE PLOTTING OVERLAYS THE IMAGE MANTAINING THE PERSPECTIVE RECTIFICATION AND PLOTTING OF SINGLE IMAGE THE ORIENTATIÓN.
ROBOT VISION Lesson 4: Camera Models and Calibration Matthias Rüther Slides partial courtesy of Marc Pollefeys Department of Computer Science University.
3D Reconstruction Using Image Sequence
Single-view geometry Odilon Redon, Cyclops, 1914.
EECS 274 Computer Vision Projective Structure from Motion.
Camera calibration from multiple view of a 2D object, using a global non linear minimization method Computer Engineering YOO GWI HYEON.
فصل 7 : مشخصات و هندسه عکس قائم
Quality of Images.
Geometric Model of Camera
Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/4/17
Overview Pin-hole model From 3D to 2D Camera projection
Camera Calibration class 9
Definitions of the image coordinate system and rotation angles
Presentation transcript:

Universität Hannover Institut für Photogrammetrie und GeoInformation Issues and Method for In-Flight and On-Orbit Calibration (only geometry) Karsten Jacobsen Institute of Photogrammetry and GeoInformation University of Hannover

Universität Hannover Institut für Photogrammetrie und GeoInformation Camera Calibration Reconstruction of the bundle of rays from the projection center to the object based on measured image positions Inner orientation of sensor Exterior orientation = location of projection center + attitude information System calibration = inner orientation + relation to positional sensors

Universität Hannover Institut für Photogrammetrie und GeoInformation Inner Orientation photographic camera – fiducial marks digital array camera – principal point F(line, sample) CCD-line sensors Inner orientation only for 1 CCD- line ‘‘ 

Universität Hannover Institut für Photogrammetrie und GeoInformation Deformation of the bundle of rays - “systematic image errors“ deformation of bundle of rays causing “systematic image errors“ = effect in images “systematic image errors OEEPE test block “direct sensor orientation“ averaged image company 2 company 1 coordinate residuals (66 images, 1484 image points) image deformed bundle of rays

Universität Hannover Institut für Photogrammetrie und GeoInformation Self calibration by additional parameters Set of additional unknowns for fitting systematic errors Additional parameters from Gotthard / Ebner optimal if image points located in Gruber points – only mathematic interpretation

Universität Hannover Institut für Photogrammetrie und GeoInformation Additional parameters Jacobsen (program system BLUH) angular affinity affinity mathematic justification mathematic tangential distortion radial symmetric distortion radial sym. mathematic mixture between physical and mathematical justification – parameters less correlated like with Ebner set if image points randomly distributed

Universität Hannover Institut für Photogrammetrie und GeoInformation radial symmetric additional parameters Often used:  r = K1* r 3 + K2* r 5 + K3* r 7 disadvantage: highly correlated, K2 and K3 effective only in corner Program system BLUH:  r = P9* (r 3 – A*r) + P10*r*sin(r*A/(2  ) + P11*r*sin(r*A/(4  ) correlation matrix same data set: correlation K1 – K2 = 0.94 only K1 P9 – P11

Universität Hannover Institut für Photogrammetrie und GeoInformation in-flight calibration of photographic aerial cameras Bundle adjustment with self-calibration by additional parameters -based on the over-determination of the bundle adjustment + control point information 1.Standard block configuration – only parallel flight lines: affinity parameters depending upon control points, other just by over-determination 2. Crossing flight lines – also affinity parameters just by over-determination  OEEPE test block “direct sensor orientation”, image scale 1 : 5000, 1 :

Universität Hannover Institut für Photogrammetrie und GeoInformation determination of focal length and principal point hg1 –  Z1 hg2 –  Z2 control points GPS-SHIFT STANDARD DEVIATION X Y Z SX SY SZ GPS DATA FOR DATA SET GPS DATA FOR DATA SET CHANGE OF FOCAL LENGTH.039 = CORR. FOR F -> GPS-SHIFT ABSOLUT under standard conditions of aerial images determination of focal length not possible – strong correlation Zo – focal length Z of projection centers required – possible by GPS, but problems with GPS datum shift, no separation of GPS datum and focal length - 2 different flying height levels required (like in OEEPE test block)

Universität Hannover Institut für Photogrammetrie und GeoInformation Digital aerial array cameras No problems with film deformation, CCD-array usually perfect flat, main problem caused by optics + affinity of CCD (will never change) “systematic image errors” of synthetic ZI-DMC images (flight over test area) – small affinity deformation, has been confirmed by following laboratory calibration - original distortion of 4 single optics always respected “systematic image errors” of CCD- array camera Rollei Q16 typical strong radial symmetric distortion of off-the-shelf optics

Universität Hannover Institut für Photogrammetrie und GeoInformation Digital aerial array cameras “systematic image” errors of the ThermScan camera – tangential distortion wide angle optics normal angle optics – largest vector 1.7 pixels If optics are exchanged, focal length and principal points have to be calibrated again focus has to be fixed, after change of focus and going back, not same inner orientation calibration of zoom-lenses not possible, inner optical system has no sufficient stability, may change after shaking the camera

Universität Hannover Institut für Photogrammetrie und GeoInformation line scan cameras HRSC CCD-line camera linearity of CCD-line by laboratory calibration can also be calibrated under flight conditions, higher number of control points or crossing flight lines required real problem: boresight

Universität Hannover Institut für Photogrammetrie und GeoInformation CCD-line cameras IRS-1C Pan-camera 3 combined CCD-lines available configuration for calibration determined geometry most CCD-line cameras used in space equipped with a combination of shorter CCD-lines, calibration under flight conditions required, with combination of images taken from different orbits reduction of required number of control points

Universität Hannover Institut für Photogrammetrie und GeoInformation “level 1A” space images QuickBird SPOT ASTER “systematic image errors” of the orientation of level 1A space images - no calibration, dominated by exterior orientation - in general sub-pixel accuracy possible

Universität Hannover Institut für Photogrammetrie und GeoInformation conclusion Perspective aerial cameras can and should be calibrated under flight conditions by bundle block adjustment with self-calibration by additional parameters – optimal set of parameters should be used, statistical analysis of parameters required Stability of film-camera calibration limited, only parts stable over time focal length and principal point can only be determined by 2 different flying heights + GPS-projection center coordinates Digital CCD-array cameras mainly influenced by optical distortion CCD-line cameras used in space usually do use a combination of shorter CCD-lines, has to be calibrated under flight conditions