Building a Real Camera.

Slides:



Advertisements
Similar presentations
The Camera : Computational Photography Alexei Efros, CMU, Fall 2006.
Advertisements

776 Computer Vision Jan-Michael Frahm, Enrique Dunn Spring 2013.
CSE 473/573 Computer Vision and Image Processing (CVIP) Ifeoma Nwogu Lecture 4 – Image formation(part I)
CS 691 Computational Photography Instructor: Gianfranco Doretto 3D to 2D Projections.
Computer Vision CS 776 Spring 2014 Cameras & Photogrammetry 1 Prof. Alex Berg (Slide credits to many folks on individual slides)
Lab 10: Lenses 1.Focal Length 2.Magnification 3.Lens Equation 4.Depth of Field 5.Spherical Aberrations and Curved Focal Plane 6.Chromatic Aberration 7.Astigmatism.
Review Pinhole projection model What are vanishing points and vanishing lines? What is orthographic projection? How can we approximate orthographic projection?
Algorithms and Applications in Computer Vision Lihi Zelnik-Manor
The Camera CS194: Image Manipulation & Computational Photography Alexei Efros, UC Berkeley, Fall 2014.
Projection Readings Szeliski 2.1. Projection Readings Szeliski 2.1.
Image formation and cameras CSE P 576 Larry Zitnick Many slides courtesy of Steve Seitz.
Cameras. Overview The pinhole projection model Qualitative properties Perspective projection matrix Cameras with lenses Depth of focus Field of view Lens.
Advanced Computer Vision Cameras, Lenses and Sensors.
Announcements. Projection Today’s Readings Nalwa 2.1.
Lecture 5: Projection CS6670: Computer Vision Noah Snavely.
Announcements Mailing list (you should have received messages) Project 1 additional test sequences online Talk today on “Lightfield photography” by Ren.
Lecture 5: Cameras and Projection CS6670: Computer Vision Noah Snavely.
Announcements Mailing list Project 1 test the turnin procedure *this week* (make sure it works) vote on best artifacts in next week’s class Project 2 groups.
Lecture 4a: Cameras CS6670: Computer Vision Noah Snavely Source: S. Lazebnik.
Today: The Camera. Overview The pinhole projection model Qualitative properties Perspective projection matrix Cameras with lenses Depth of focus Field.
Single-view Metrology and Camera Calibration Computer Vision Derek Hoiem, University of Illinois 02/26/15 1.
Image Formation III Chapter 1 (Forsyth&Ponce) Cameras “Lenses”
Computer Vision Cameras, lenses and sensors Cosimo Distante Introduction to Image Processing Image.
The Camera : Computational Photography Alexei Efros, CMU, Fall 2008.
Image formation and cameras
Perspective projection
Cameras CSE 455, Winter 2010 January 25, 2010.
Image formation How are objects in the world captured in an image?
Northeastern University, Fall 2005 CSG242: Computational Photography Ramesh Raskar Mitsubishi Electric Research Labs Northeastern University September.
Image Formation and Representation CS485/685 Computer Vision Dr. George Bebis.
1 Digital Cameras Consumer digital cameras have been around since 1995 What features make a good camera? How do we optimize good features with a limited.
776 Computer Vision Jan-Michael Frahm Fall Camera.
776 Computer Vision Jan-Michael Frahm Spring 2012.
Recap from Wednesday Two strategies for realistic rendering capture real world data synthesize from bottom up Both have existed for 500 years. Both are.
776 Computer Vision Jan-Michael Frahm, Enrique Dunn Spring 2013.
COMPUTER VISION D10K-7C02 CV02: Camera Dr. Setiawan Hadi, M.Sc.CS. Program Studi S-1 Teknik Informatika FMIPA Universitas Padjadjaran.
1 Computer Vision 一目 了然 一目 了然 一看 便知 一看 便知 眼睛 頭腦 眼睛 頭腦 Computer = Image + Artificial Vision Processing Intelligence Vision Processing Intelligence.
Computational Photography
776 Computer Vision Jan-Michael Frahm Fall Last class.
EECS 274 Computer Vision Cameras.
Miguel Tavares Coimbra
CSE 185 Introduction to Computer Vision Cameras. Camera models –Pinhole Perspective Projection –Affine Projection –Spherical Perspective Projection Camera.
Projection Readings Nalwa 2.1 Szeliski, Ch , 2.1
The Physics of Photography
DIGITAL CAMERAS Prof Oakes. Overview Camera history Digital Cameras/Digital Images Image Capture Image Display Frame Rate Progressive and Interlaced scans.
Human Vision and Cameras CS 691 E Spring Outline Human vision system Human vision for computer vision Cameras and image formation Projection geometry.
Instructor: Mircea Nicolescu Lecture 3 CS 485 / 685 Computer Vision.
CS559: Computer Graphics Lecture 3: Image Sampling and Filtering Li Zhang Spring 2010.
More with Pinhole + Single-view Metrology
Image Formation and Cameras CSE 455 Linda Shapiro 1.
Image Formation III Chapter 1 (Forsyth&Ponce) Cameras “Lenses” Guido Gerig CS-GY 6643, Spring 2016 (slides modified from Marc Pollefeys, UNC Chapel Hill/
Announcements Project 1 grading session this Thursday 2:30-5pm, Sieg 327 –signup ASAP:signup –10 minute slot to demo your project for a TA »have your program.
CSE 185 Introduction to Computer Vision
PNU Machine Vision Lecture 2a: Cameras Source: S. Lazebnik.
Jan-Michael Frahm Fall 2016
The Camera : Computational Photography
Announcements Project 1 Project 2
CSE 185 Introduction to Computer Vision
Jan-Michael Frahm Fall 2016
EECS 274 Computer Vision Cameras.
The Camera : Computational Photography
Announcements Midterm out today Project 1 demos.
Human Vision and Cameras
Projection Readings Nalwa 2.1.
Credit: CS231a, Stanford, Silvio Savarese
Projection Readings Szeliski 2.1.
Announcements Midterm out today Project 1 demos.
Photographic Image Formation I
The Camera.
Presentation transcript:

Building a Real Camera

Home-made pinhole camera http://www.debevec.org/Pinhole/ Slide by A. Efros

Shrinking the aperture Why not make the aperture as small as possible? Less light gets through Diffraction effects… Slide by Steve Seitz

Shrinking the aperture

Adding a lens

Adding a lens A lens focuses light onto the film Thin lens model: Rays passing through the center are not deviated (pinhole projection model still holds) Slide by Steve Seitz

Adding a lens A lens focuses light onto the film f Thin lens model: focal point f A lens focuses light onto the film Thin lens model: Rays passing through the center are not deviated (pinhole projection model still holds) All parallel rays converge to one point on a plane located at the focal length f Slide by Steve Seitz

Adding a lens A lens focuses light onto the film “circle of confusion” A lens focuses light onto the film There is a specific distance at which objects are “in focus” other points project to a “circle of confusion” in the image Slide by Steve Seitz

Thin lens formula What is the relation between the focal length ( f ), the distance of the object from the optical center (D), and the distance at which the object will be in focus (D′)? D′ D f This is the relation between the focal length (f), the distance of the object from the camera (D), and the distance at which the object will be in focus (D’) image plane lens object Slide by Frédo Durand

D′ D f Thin lens formula Similar triangles everywhere! image plane object Slide by Frédo Durand

y′/y = D′/D D′ D f y y′ Thin lens formula Similar triangles everywhere! D′ D f y y′ image plane lens object Slide by Frédo Durand

y′/y = D′/D y′/y = (D′−f )/f D′ D f y y′ Thin lens formula Similar triangles everywhere! y′/y = (D′−f )/f D′ D f y y′ image plane lens object Slide by Frédo Durand

1 1 1 + = D′ D f D′ D f Thin lens formula Any point satisfying the thin lens equation is in focus. + = D′ D f D′ D f And the set of all such points forms a plane parallel to the image (plane of focus). Uses of the formula: given focal length and depth in scene that you want to be in focus, it tells you where to put the image plane. Given f and distance of image plane from camera center, it tells you which depth in the scene will be in focus. image plane lens object Slide by Frédo Durand

Depth of Field Depth of field is the distance between the nearest and farthest objects in a scene that appear acceptably sharp in an image (Wikipedia) http://www.cambridgeincolour.com/tutorials/depth-of-field.htm Slide by A. Efros

Controlling depth of field Changing the aperture size affects depth of field A smaller aperture increases the range in which the object is approximately in focus But small aperture reduces amount of light – need to increase exposure http://en.wikipedia.org/wiki/File:Depth_of_field_illustration.svg

Varying the aperture Large aperture = small DOF Small aperture = large DOF Slide by A. Efros

Field of View The field of view is the angular extent of the world that is observed by the camera. Slide by A. Efros

Field of View Slide by A. Efros

Field of View f f FOV depends on focal length and size of the camera retina Larger focal length = smaller FOV Slide by A. Efros

Field of View / Focal Length Large FOV, small f Camera close to car Small FOV, large f Camera far from the car Sources: A. Efros, F. Durand

Same effect for faces standard wide-angle telephoto Source: F. Durand

Review Perspective projection in homogeneous coordinates Linearity Orthographic projection

Approximating an orthographic camera Source: Hartley & Zisserman

The dolly zoom Continuously adjusting the focal length while the camera moves away from (or towards) the subject http://en.wikipedia.org/wiki/Dolly_zoom

The dolly zoom Continuously adjusting the focal length while the camera moves away from (or towards) the subject “The Vertigo shot” Example of dolly zoom from Goodfellas (YouTube) Example of dolly zoom from La Haine (YouTube)

Review Perspective projection in homogeneous coordinates Linearity Orthographic projection Lenses Depth of field Field of view

Real lenses

Real lenses

Lens Flaws: Chromatic Aberration Lens has different refractive indices for different wavelengths: causes color fringing Near Lens Center Near Lens Outer Edge

Lens flaws: Spherical aberration Spherical lenses don’t focus light perfectly Rays farther from the optical axis focus closer

Lens flaws: Vignetting

Radial Distortion Caused by imperfect lenses Deviations are most noticeable near the edge of the lens No distortion Pin cushion Barrel

Digital camera A digital camera replaces film with a sensor array Each cell in the array is light-sensitive diode that converts photons to electrons Two common types Charge Coupled Device (CCD) Complementary metal oxide semiconductor (CMOS) http://electronics.howstuffworks.com/digital-camera.htm Slide by Steve Seitz

Color sensing in camera: Color filter array Bayer grid Estimate missing components from neighboring values (demosaicing) Why more green? Human Luminance Sensitivity Function Source: Steve Seitz

Problem with demosaicing: color moire Slide by F. Durand

The cause of color moire detector Fine black and white detail in image misinterpreted as color information Slide by F. Durand

Digital camera artifacts Noise low light is where you most notice noise light sensitivity (ISO) / noise tradeoff stuck pixels In-camera processing oversharpening can produce halos Compression JPEG artifacts, blocking Blooming charge overflowing into neighboring pixels Color artifacts purple fringing from microlenses, white balance Slide by Steve Seitz

Historic milestones Pinhole model: Mozi (470-390 BCE), Aristotle (384-322 BCE) Principles of optics (including lenses): Alhacen (965-1039 CE) Camera obscura: Leonardo da Vinci (1452-1519), Johann Zahn (1631-1707) First photo: Joseph Nicephore Niepce (1822) Daguerréotypes (1839) Photographic film (Eastman, 1889) Cinema (Lumière Brothers, 1895) Color Photography (Lumière Brothers, 1908) Television (Baird, Farnsworth, Zworykin, 1920s) First consumer camera with CCD Sony Mavica (1981) First fully digital camera: Kodak DCS100 (1990) Alhacen’s notes Niepce, “La Table Servie,” 1822 Old television camera

First digitally scanned photograph 1957, 176x176 pixels From the website: “Russell Kirsch was a computer pioneer at the National Institute of Standards and Technology in the USA when he developed the system by which a camera could be fed into a computer. The photo is of Kirsch’s three month old son Walden and it measured a mere 176×176 pixels. Baby Walden now works in communications for Intel.” http://listverse.com/history/top-10-incredible-early-firsts-in-photography/