SDP 12 Project “PRASER” Senior Design Project Final Project Review Team Mosaic Advisor: Professor Lixin Gao Members: Allen Chew, Charles Essien, Brian Giang, Simon Ma Evaluators: Professor Gong, Professor Vouvakis

2 SDP 12 2 Agenda  Introduction Refined project definition Comparison  Project Specification System block diagram Subsystem components Application Accomplished Demonstration

3 SDP 12 3 Reintroduction - Motivation  Online presentations are boring Difficult to view both presentation and presenter at the same time Low quality slides (streaming video) Loss of focus on presenter  Viewing remote presentations Bad visual quality Loss of expression

4 SDP 12 4 Comparison  For most presentations, Difficult to capture both the presenter and Power Point at the same time Requires a cameraman  However our prototype application Capable of capture both the presenter and Power Point Addition functions/gestures

5 SDP 12 5 Reintroduction - Goals We want to:  Improve presentation experience More interactive More entertaining  Rethink approach to capturing presentations Bring focus back to the presenter Facilitate “emotion” for remote presentation

6 SDP 12 6 Design Specification – Project Definition Praser is … “A redesigned platform capable of delivering an enhanced presentation experience, both for in person and remote viewers.”  More interactive utility for presenters  Better experience for viewers with avatars

7 SDP 12 7 Design Specifications –Block Diagram System Block Diagram

8 SDP 12 8 Design Specifications – Kinect Subsystem  OpenNI & NITE Generate “users” Return interpreted motions and gestures  OpenGL Real-time image manipulation OpenNI NITE OpenGL

9 SDP 12 9 Kinect Subsystem - Capabilities  Gesture Recognition Hand gestures for control User poses  Tracking Mapping user position to screen Location based “selections”  Compositing Background removal Image manipulation

10 SDP Kinect Subsystem – Avatar Application  Capture presenter in on screen avatar  Walk around and point modes X, Y coordinates mapped with Kinect Depth information Presenter avatar points mapped to actual points

11 SDP Kinect Subsystem – Avatar Application cont’d Benefits:  More expression and emotion  Better interaction with slideshow slides  More efficient remote viewing of presentation

12 SDP Accomplished  Hand Tracking  Hand Gestures  Video Recording  Layer Control – Presenter, Power Point Slides, Annotations  Selecting specific Power Point Slides  Displaying two slides at once – Splitting

13 SDP 12 Kinect Demonstration 13

14 SDP The Future  Writing Recognition when annotating.  Capturing the presenter in 3-D using two Kinects.  Using the Kinect for other purposes (e.g. medical diagnostics and therapy)

15 SDP Problems Addressed  Purchased safety goggles to prevent retinal damage  Blanking not currently implemented  For safety reasons decided would be best not to use the laser system in this project.  Memory Leak in software  Video Recording  Threading  Tracking and Scaling

16 SDP Team Responsibility Allen Chew (CSE) – Team Manager, Coordinated laser projection system, Software Development, Researched on how to build correctional amplifier, Researched and ordered parts for project in a timely manner Charles Essien (CSE) – Software coordinator, Research graphics libraries, Isolated user pixels and overlay onto slides, Created Flow and Calibration, Split Screen Brian Giang (EE) – Laser Projection Coordinator, Coordinated team meetings and set deadlines, Assembled laser projection system and figured signal lines from DAC Simon Ma (CSE) – Compiled OpenLase Binaries, Ported code over to Ubuntu, Coordinated hand tracking and gestures, Created Annotations

17 SDP The End Thank you very much for your time. I hope you enjoyed the presentation. Questions?

18 SDP Design Specifications –Laser Subsystem  Laser subsystem manipulates a laser to create image based on persistence of vision.  Four major components: Galvo, DAC, Laser Pointer, Power Supply  Galvanometer - reflect the laser on x & y axis  Digital to Analog Converter - communication between the computer and galvo

19 SDP Laser System Design – Galvanometer

20 SDP 12 Laser System Demo 20

21 SDP Final Design Review  Final design and start prototyping applications  Praser Interface with the Kinect as input  A fully working laser system that will project onto any surface  Using the laser, draw more complex animations and implement a menu system.

22 SDP FDR - Internal deadlines February - April Spring Break Implement blanking in laser system Calibrate to ILDA standards Have Kinect program interact with OpenLase Develop applications with Kinect input FDR – April 2-6

23 SDP FDR - Internal deadlines FDR – April 2-6

24 SDP Application Layers

25 SDP Laser System Design – Entire System  OpenLase converts ILDA files to sound  Soundcard outputs three different signals: Right stereo channel orients X galvo Left stereo channel orients Y galvo Green Laser Modulation turns on/off the laser

26 SDP 12 Correctional Opamp  Built a negating opamp circuit to simulate a differential signal suitable for galvo 26

27 SDP Laser System Design – SmartPoint Application  “Smarter” laser pointer  Laser menu and utilities  Presenter holds hand up to reveal menu  Grab and manipulate elements from slides E.g. copy a figure to board

28 SDP Design Specifications -Hardware  Kinect Specification 30Hz 8-bit VGA resolution (640 × 480 pixels) Usable distance 3.9 ft – 11 ft Angular FOV 57° horizontally and 43° vertically motorized tilting up to 27° minimum viewing horizontal distance of 34 in minimum viewing vertical 63 cm microphone array features four microphone capsules