Presentation on theme: "3D Computer Vision: CSc 83020. Instructor: Ioannis Stamos istamos (at) hunter.cuny.edu Office Hours: Tuesdays 4-6."— Presentation transcript:
3D Computer Vision: CSc 83020
Instructor: Ioannis Stamos istamos (at) hunter.cuny.edu Office Hours: Tuesdays 4-6 (at Hunter) or by appoitnment Office: 1090G Hunter North (69 th street bw. Park and Lex.) Computer Vision Lab: 1090E Hunter North Course web page: 3D Computer Vision: CSc 83020
Goals To familiarize you with basic the techniques and jargon in the field To enable you to solve computer vision problems To let you experience (and appreciate!) the difficulties of real-world computer vision To get you excited!
Class Policy You have to –Turn in all assignments (60% of grade) –Complete a final project (30% of grade) –Actively participate in class (10% of grade) Late policy –Six late days (but not for final project) Teaming –For final project you can work in groups of 2
About me 11 th year at Hunter and the Graduate Center Graduated from Columbia in ’01 –CS Ph.D. Research Areas: –Computer Vision –3D Modeling –Computer Graphics
Books Computer Vision: Algorithms and Applications, Richard Szeliski, 2010 (available online for free) Robot Vision B. K. P. Horn, The MIT Press (great classic book) Introductory Techniques for 3-D Computer Vision Emanuele Trucco and Alessandro Verri, Prentice Hall, 1998 (algorithmic perspective) Computer Vision A Modern Approach David A. Forsyth, Jean Ponce, Prentice Hall 2003 An Invitation to 3-D Vision Yi Ma, Stefano Soatto, Jana Kosecka, S. Shankar Sastry Springer Three-Dimensional Computer Vision: A Geometric Viewpoint Olivier Faugeras The MIT Press, 1996.
Journals/Web International Journal of Computer Vision. Computer Vision and Image Understanding. IEEE Trans. on Pattern Analysis and Machine Intelligence. SIGGRAPH (mostly Graphics) (CMU’s Robotic Institute)http://www.ri.cmu.edu/ (The Vision Home Page) (CV Online) (Annotated CV Bibliography)
Class History Based on class taught at Columbia University by Prof. Shree Nayar. New material reflects modern approach. Taught similar class at Hunter Taught “3D Photography” class at the Graduate Center of CUNY. My active research area –Funded by the National Science Foundation
Class Schedule Check class website Final project proposals –Due Nov. 7 –Design your own or check list of possible projects on class website Final project presentations and report –May 16 (last class)
What is Computer Vision? Physical 3D World Illumination Vision System Scene Description Measuring Visual Information Sensors Images or Video
Computer Graphics Image Output Model Synthetic Camera (slides courtesy of Michael Cohen)
Real Scene Computer Vision Real Cameras Model Output (slides courtesy of Michael Cohen)
Combined Model Real Scene Real Cameras Image Output Synthetic Camera (slides courtesy of Michael Cohen)
Cont. Vision is automating visual processes (Ball & Brown). Vision is an information processing task (Marr). Vision is inverting image formation (Horn). Vision is inverse graphics. Vision looks easy, but is difficult. Vision is difficult, but it is fun (Kanade). Vision is useful.
Some Applications Industrial –Material Handling –Inspection –Assembly
Some Applications Autonomous Navigation
Vision for Graphics Film Industry Urban Planning E-commerce Virtual Reality Some Applications
Realistic 3D experience –Google Earth –Microsoft Photosynth
More Applications! Optical Character Recognition (OCR) Visual Databases (images or movies) –Searching for image content Face Recognition (security) Iris Recognition (security) Traffic Monitoring Systems Many more…
Vision deals with images
Images Look Nice…
Ioannis Stamos – CSc Spring 2007 Images Look Nice…
...Essentially a 2D array of numbers
Low-Level or “Early” Vision Considers local properties of an image “There’s an edge!” Szymon Rusinkiewicz, Princeton. From: Szymon Rusinkiewicz, Princeton.
Mid-Level Vision Grouping and segmentation “There’s an object and a background!”
High-Level Vision Recognition “It’s a chair!”
Humans Vision is easy for us. But how do we do it?
Human Vision: Illusions Fraser’s spiral (Fraser 1908)