1. Vision, Video and Virtual Reality Introduction Lecture 1 Objectives, Lectures and Project Topics CSC 59866CD Fall 2004 Zhigang Zhu, NAC 8/203A http://www-cs.engr.ccny.cuny.edu/~zhu/ Capstone2004/Capstone_Sequence2004.html

2. Vision, Video and Virtual Reality Lecture Outline n Capstone Objectives and Plans n Project Topics (for Spring 2005) n Lectures (Fall 2004) n Tools (C++ or Java with OpenGL) n Teams (2?)

3. Vision, Video and Virtual Reality Objectives and Plans n Objectives l Put what you learn in class into projects of real applications n Course Plan – Fall 2004 l M &W 12:15 pm – 1:45 pm n 1.5 hours lecture each on Vision, Video and Virtual Reality l Mon 3:00 – 4:00 pm n 30 minutes each week meeting with individual student teams (half an hour per team) l After Class n Reading, Discussions, Exercises, OpenGL/Java 3D Tutorials (self) l Form teams n And update project requirements and design n Course Plan – Spring 2005 l Project Design and Development (2 hours per week) l Meeting and Reporting (1 hour per team per week) l Final Report and Papers

4. Vision, Video and Virtual Reality Project Topics n Real-World Applications of Video Computing l Entertainment, Education and HCI Entertainment, Education and HCI n Computer Vision and Video in ITS and Security l Augmented New York City Augmented New York City n CCNY\Working\NYC_VC\AugmentedNYC\AugmentedNYC.exe n C++ and OpenGL n Computer Vision in Education l Virtualized Classroom Virtualized Classroom n Desktop\VCPlayer\VCPlayer_New_V1.jar n Java Sun One Studio

5. Vision, Video and Virtual Reality Enable Technologies n Sensor Technologies l EO/IR Cameras, Magnetic Loops l Microphone arrays, digital whiteboard systems, n Multimedia (Video) Communications l Audio/Video steaming, compression and transmission l Wireless Communication n Data Mining and Information Retrieval l Traffic analysis, prediction and anomaly detection l Learning material indexing and searching n Computer Vision and Virtualization l Human and vehicle detection, extraction and tracking (Video Computing) l Information Visualization (Image-Based Rendering - IBR) l Virtual – Real Integration (Augmented Reality- AR)

6. Vision, Video and Virtual Reality Lectures (28) n Introduction: Vision, Video and Virtual Reality (3) l Intro (1), Augmented -NYC(1), Virtualized Classroom (1) n Visual Sensors, Image and Video Formation (3) l Sensors (1), omnidirectional (1), image formation (1) n 2D Vision: Image Enhancement, Edges and Contours (3) l Enhancement (1), edge (1), segmentation (1) n Camera Models and 3D Graphics: From 3D to 2D (4) l 3D OpenGL (2), camera model (1), calibration (1) n 3D Vision (Stereo and Motion): From 3D to 2D (4) l Stereo (2), motion (2) n Visual Representation: Mosaics & Layers (3) l Mosaics (1), OmniStereo (1), Layers (1) n Image-Based Rendering and Augmented Reality ( 4) l IBM&R (2), AR(2) – NYC project and VC project n Content-Based Video Computing (4) l Tracking (1), NYC project (1) VC project (1), summary (1)

7. Vision, Video and Virtual Reality Tools n Technical Preparation (this course) l 3D Computer Vision l 2D image processing l 3D Computer Graphics (OpenGL) n Programming Environments (mainly on your own) l C++ and OpenGL (for Augmented NYC and Virtualized Classroom) n NeHe OpenGL Tutorials (with C++ code samples) NeHe OpenGL Tutorials (with C++ code samples) http://nehe.gamedev.net/ l Java and/or Java 3D / OpenGL ( for Virtualized Classroom) n Sun ONE Studio 4 CE n Java 3D has a high level implementation of OpenGL http://java.sun.com/products/java-media/3D/ l Audio/Video Streaming

8. Vision, Video and Virtual Reality Tentative Teams n Team 1 – Augmented New York City (C++) n Team 2 – Virtualized Classroom (Java) n Current Students l Hill, Robert l Molina, Edgardo l Velasco, Emmanuel l Giang, Peter (?) l Ram, Krishnan (?) l Fares, Hussein (?)

9. Vision, Video and Virtual Reality Next n Project Topic 1 Augmented NYC n Checking out the following site for OpenGL tutorials NeHe OpenGL Tutorials (with C++ code samples) http://nehe.gamedev.net/ n Java 3D has a high level implementation of OpenGL http://java.sun.com/products/java-media/3D/