2. Welcome Basic Concept Research Justification The Project Implementation Potential Issues Future Work What am going to talk about?

3. What am I interested in? Bringing the interactor into the experience Merging virtual and physical space Allowing for natural body movement during interaction Permitting physical objects to be used as interface devices Exploring tangible interaction Basic Concept

4. OK, but why? Research Justification Discover new forms of interaction Exploration of ambient intelligence Model for future ubiquitous computing applications Get us out from behind our desks No more carpel tunnel syndrome!

5. OK, but why? Research Justification But mostly because I think it’s cool!

6. Swarm: An Augmented Reality Experience The Project You reach into a box that appears to have a transparent top. Inside are two colored balls. You grab the balls, one in each hand, which causes colored particles to begin to swarm. The particles are drawn to the balls and move both in front of and behind your hands like magical fireflies, following every gesture that you make.

7. Form Factor The Project

8. How does it work? Implementation Augmented Reality + Video Chroma Key

9. The Compositing Process Implementation

10. How does it work? Implementation Hardware Box Projector Colored Balls Software Jitter Processing

11. Hardware Implementation The Box Green Rear Wall Mirror Lights Webcam

12. Inside the Box Implementation

13. Software Implementation Jitter Color Detection Track hand positions Send data to Proce55ing

14. Software Implementation Proce55ing Chroma Key Draw the particles Recombine the 3 video layers

15. Primary Concerns Potential Issues Processing Power Distributed Computing Multiple Computers WebCam Camera Angle Wide Angle Lens Video Chroma Key Issues

16. Where do I go from here? Future Work Graphics Incorporate 3d Animation Ambient Intelligence Make the balls “clickable” Scale Full body Experiences

17. FIN Thank you!