1. By: Kenzo Abrahams Supervisor: Mehrdad Ghaziasgar Co-supervisor: James Connan Mentored by: Diego Mushfieldt

2. Overview Introduction Design Decisions and System Changes Implementation Tools Used Project Plan Demo

3. Introduction Interactive Conducting System Tracks hands using webcam Real-time alterations depending on hand gestures Change volume Change tempo

4. Design Decisions and System changes Use Haar classifiers to detect the face Dynamically check for skin colour Track left hand only when needed

5. Implementation Detect face and block it out

6. Implementation Convert frame into HSV colour space

7. Implementation set hand as region of interest

8. Implementation HSV image split up into separate components

9. Implementation Create histogram of skin colour

10. Implementation Track the right hand (CAMshift)

11. Implementation Play music

12. Implementation Choose ensemble or entire orchestra

13. Implementation Track left hand

14. Tools Used Ubuntu 12.04 Qt Creator with Qt 4.7 OpenCV 2.4 Rtcmix 4.0.1

15. Demo Demo Overview Track right hand Change the tempo of music Track left hand Decrease volume of symphony Increase volume of one ensemble

16. Project Plan GoalDue Date Learn how to use OpenCV and its tools. Elicit the requirements and define a designers interpretation of the problem. Completed From the users requirements design a prototype for the system Completed Construct the system with all its functionality present Completed Test the system and deployment Term 4

17. References O'Niel, D L. (2008). Music Theater Jobs. Available: http://www.ehow.com/list_6547349_music-theater-jobs.html. Last accessed 29th March 2012. Bradski, G Kaehler, A. (2008). Getting to Know OpenCV. In: Loukides, M Learning OpenCV. United States of America: O’Reilly. p31-87. Gibson, J. (2009). RTcmix Tutorial. Available: http://iub.edu/~emusic/509/rtcmixtut.htm. Last accessed 10th Sep 2012. Nakra, T., Ivanov, Y., Smaragdis, P., Ault, C.: The USB Virtual Maestro: an Interactive Conducting System, p.250-255, NIME2009 (2009). BORCHERS, J., HADJAKOS, A., AND M¨UHLH¨AUSER, M. MICON (2006) A music stand for interactive conducting. Proceedings of the 2006 conference on New interfaces for musical expression, p254–259. Viola, P. Jones, M. (2001). Rapid Object Detection using a Boosted Cascade of Simple Features. Conference on computer vision and pattern matching 2001. Lansky, A. (2005). An Open-Source, Digital Signal Processing and Sound Synthesis Language. Available: http://rtcmix.org/. Last accessed 27th May 2012. Nokia. (2009). Qt. Available: http://qt.nokia.com/products. Last accessed 10th Sep 2012.

18. Question and Answers