1. AIR GUITAR ENEE408G FINAL PROJECT Kathryn Marcotte, Nicholas Prior, Eshani Tarpara, Wade Woodall

2. Motivation Create a program to allow people to translate untrained movement into their own music.

3. Goals  Create a customized profile for every user that notes where they place each guitar hand  Detect a user’s hand movements as definitive chords played on a guitar to within 80% accuracy  Play the chosen guitar chords live to within 80% accuracy  Allow users to record their music for future replay

4. Approach Used  Video Processing  Audio Synthesis  demo  Music Creation  Music Replay

5. Initialization Hand in bottom strum box Top_Flag Exit_Flag Grab Frame Program Start Grab Color Initialize Chord Positions Initialize Strum Positions Determine Chord Position Play Chord Top_Flag = 0 Hand in top strum box Top_Flag = 1 Record? Terminate Publish Sound File No Yes No Yes

6. Hand in bottom strum box Top_Flag Exit_Flag Grab Frame Program Start Grab Color Initialize Chord Positions Initialize Strum Positions Determine Chord Position Play Chord Top_Flag = 0 Hand in top strum box Record? Terminate Publish Sound File No Yes No Yes Top_Flag = 1

7. Hand in bottom strum box Top_Flag Exit_Flag Grab Frame Program Start Grab Color Initialize Chord Positions Initialize Strum Positions Determine Chord Position Play Chord Top_Flag = 0 Hand in top strum box Top_Flag = 1 Record? Terminate Publish Sound File No Yes No Yes

8. Hand in bottom strum box Top_Flag Exit_Flag Grab Frame Program Start Grab Color Initialize Chord Positions Initialize Strum Positions Determine Chord Position Play Chord Top_Flag = 0 Hand in top strum box Top_Flag =1 Record? Terminate Publish Sound File No Yes No Yes

9. Hand in bottom strum box Top_Flag Exit_Flag Grab Frame Program Start Grab Color Initialize Chord Positions Initialize Strum Positions Determine Chord Position Play Chord Top_Flag = 0 Hand in top strum box Top_Flag = 1 Record? Terminate Publish Sound File No Yes No Yes

10. Hand in bottom strum box Top_Flag Exit_Flag Grab Frame Program Start Grab Color Initialize Chord Positions Initialize Strum Positions Determine Chord Position Play Chord Top_Flag = 0 Hand in top strum box Top_Flag = 1 Record? Terminate Publish Sound File No Yes No Yes

11. Hand in bottom strum box Top_Flag Exit_Flag Grab Frame Program Start Grab Color Initialize Chord Positions Initialize Strum Positions Determine Chord Position Play Chord Top_Flag = 0 Hand in top strum box Top_Flag = 1 Record? Terminate Publish Sound File No Yes No Yes

12. Hand in bottom strum box Top_Flag Exit_Flag Grab Frame Program Start Grab Color Initialize Chord Positions Initialize Strum Positions Determine Chord Position Play Chord Top_Flag = 0 Hand in top strum box Top_Flag = 1 Record? Terminate Publish Sound File No Yes No Yes

13. Hand in bottom strum box Top_Flag Exit_Flag Grab Frame Program Start Grab Color Initialize Chord Positions Initialize Strum Positions Determine Chord Position Play Chord Top_Flag = 0 Hand in top strum box Top_Flag = 1 Record? Terminate Publish Sound File No Yes No Yes

14. Hand in bottom strum box Top_Flag Exit_Flag Grab Frame Program Start Grab Color Initialize Chord Positions Initialize Strum Positions Determine Chord Position Play Chord Top_Flag = 0 Hand in top strum box Top_Flag = 1 Record? Terminate Publish Sound File No Yes No Yes

15. Hand in bottom strum box Top_Flag Exit_Flag Grab Frame Program Start Grab Color Initialize Chord Positions Initialize Strum Positions Determine Chord Position Play Chord Top_Flag = 0 Hand in top strum box Top_Flag = 1 Record? Terminate Publish Sound File No Yes No Yes

16. Demo