2. GesturesGestures CS5540 HCI Rich Riesenfeld Fall 2007 CS5540 HCI Rich Riesenfeld Fall 2007

3. Gestures Studies Following Gesture material from: Hand Centered Studies of Human Movement Project, School of Kinesiology, Simon Fraser University, February 1996

4. Gestures-1Gestures-1 Praying (two flat hands up together)Praying (two flat hands up together) Begging (flat hand)Begging (flat hand) Expressing anger (raising a fist)Expressing anger (raising a fist) Derogation (middle finger up)Derogation (middle finger up) Accusation (index pointing)Accusation (index pointing) Live or die decisions in the Roman amphitheater (thumb up/down)Live or die decisions in the Roman amphitheater (thumb up/down) Praying (two flat hands up together)Praying (two flat hands up together) Begging (flat hand)Begging (flat hand) Expressing anger (raising a fist)Expressing anger (raising a fist) Derogation (middle finger up)Derogation (middle finger up) Accusation (index pointing)Accusation (index pointing) Live or die decisions in the Roman amphitheater (thumb up/down)Live or die decisions in the Roman amphitheater (thumb up/down)

5. Gestures-2Gestures-2Hitch hiking

6. Student Name Server Utah School of Computing slide 5 Gestures-3Gestures-3 Legal and business transactions (handshake, judge hammering)

7. Student Name Server Utah School of Computing slide 6 Gestures-4Gestures-4 Pointing to real and abstract objects and concepts (index, hand)

8. Student Name Server Utah School of Computing slide 7 Fall 2003

9. Gestures-4Gestures-4 Waving and Saluting

10. Student Name Server Utah School of Computing slide 9 Gestures-4Gestures-4 Waving and Saluting

11. Student Name Server Utah School of Computing slide 10 Gestures-4Gestures-4 Counting (fingers and/or hand)

12. Student Name Server Utah School of Computing slide 11

13. Student Name Server Utah School of Computing slide 12 Gestures-4Gestures-4 Waving and saluting Counting (fingers and/or hand) Pointing to real and abstract objects and concepts (index, hand)

14. Student Name Server Utah School of Computing slide 13 Legal and business transactions (handshake, judge hammering)Legal and business transactions (handshake, judge hammering) Waving and salutingWaving and saluting Counting (fingers and/or hand)Counting (fingers and/or hand) Pointing to real and abstract objects and concepts (index, hand)Pointing to real and abstract objects and concepts (index, hand) Legal and business transactions (handshake, judge hammering)Legal and business transactions (handshake, judge hammering) Waving and salutingWaving and saluting Counting (fingers and/or hand)Counting (fingers and/or hand) Pointing to real and abstract objects and concepts (index, hand)Pointing to real and abstract objects and concepts (index, hand)Gestures-2Gestures-2

15. Gestures-3Gestures-3 Conducting an orchestra (variety of both gestures with arms and body)Conducting an orchestra (variety of both gestures with arms and body) Traffic control of cars and airplanes (hands flat pointing or moving)Traffic control of cars and airplanes (hands flat pointing or moving) Shaping of imagined objects (hands tracing out curves and shapes)Shaping of imagined objects (hands tracing out curves and shapes) Martial arts, fighting (variety of movements of arms and body)Martial arts, fighting (variety of movements of arms and body) Conducting an orchestra (variety of both gestures with arms and body)Conducting an orchestra (variety of both gestures with arms and body) Traffic control of cars and airplanes (hands flat pointing or moving)Traffic control of cars and airplanes (hands flat pointing or moving) Shaping of imagined objects (hands tracing out curves and shapes)Shaping of imagined objects (hands tracing out curves and shapes) Martial arts, fighting (variety of movements of arms and body)Martial arts, fighting (variety of movements of arms and body)

16. Gestures-4Gestures-4 Dance (Balinese dancing)Dance (Balinese dancing) Gesturing by singers (hand and body movements)Gesturing by singers (hand and body movements) Stock exchange operations (various hand shapes)Stock exchange operations (various hand shapes) Affective gestures (hand touching)Affective gestures (hand touching) Rejective (index up moving left & right) / appreciative (hand clapping) gesturesRejective (index up moving left & right) / appreciative (hand clapping) gestures Dance (Balinese dancing)Dance (Balinese dancing) Gesturing by singers (hand and body movements)Gesturing by singers (hand and body movements) Stock exchange operations (various hand shapes)Stock exchange operations (various hand shapes) Affective gestures (hand touching)Affective gestures (hand touching) Rejective (index up moving left & right) / appreciative (hand clapping) gesturesRejective (index up moving left & right) / appreciative (hand clapping) gestures

17. Gestures-5Gestures-5 Game playing (hand signs to communicate with partner in card games)Game playing (hand signs to communicate with partner in card games) Game scoring (cricket, basketball, soccer, rugby, football)Game scoring (cricket, basketball, soccer, rugby, football) Dinner table actions (commanding waiter to refill wine glass)Dinner table actions (commanding waiter to refill wine glass) Positioning of real (remote or close) Control Panel operations (mousing, steering a vehicle)Positioning of real (remote or close) Control Panel operations (mousing, steering a vehicle) Game playing (hand signs to communicate with partner in card games)Game playing (hand signs to communicate with partner in card games) Game scoring (cricket, basketball, soccer, rugby, football)Game scoring (cricket, basketball, soccer, rugby, football) Dinner table actions (commanding waiter to refill wine glass)Dinner table actions (commanding waiter to refill wine glass) Positioning of real (remote or close) Control Panel operations (mousing, steering a vehicle)Positioning of real (remote or close) Control Panel operations (mousing, steering a vehicle)

18. Gestures-6Gestures-6 Moving, touching and interacting with objectsMoving, touching and interacting with objects Silent and non-verbal communication (shrugging, holding one's own earlobe, scratching)Silent and non-verbal communication (shrugging, holding one's own earlobe, scratching) “Italianate" gestures (two hands open shaking)“Italianate" gestures (two hands open shaking) Moving, touching and interacting with objectsMoving, touching and interacting with objects Silent and non-verbal communication (shrugging, holding one's own earlobe, scratching)Silent and non-verbal communication (shrugging, holding one's own earlobe, scratching) “Italianate" gestures (two hands open shaking)“Italianate" gestures (two hands open shaking)

19. Gestures-7Gestures-7 Mimicry and pantomime (actions and objects are depicted with hand/body movements)Mimicry and pantomime (actions and objects are depicted with hand/body movements) sign language (a complete linguistic communication system)sign language (a complete linguistic communication system) Mimicry and pantomime (actions and objects are depicted with hand/body movements)Mimicry and pantomime (actions and objects are depicted with hand/body movements) sign language (a complete linguistic communication system)sign language (a complete linguistic communication system) Mimicry and pantomime (actions and objects are depicted with hand/body movements)Mimicry and pantomime (actions and objects are depicted with hand/body movements)

20. Gestures-8Gestures-8 Shimmering hand (maybe, maybe not)Shimmering hand (maybe, maybe not) Sign language (a complete linguistic communication system)Sign language (a complete linguistic communication system) Aircraft carrier landingsAircraft carrier landings Dog trainingDog training Gambling signals at a casinoGambling signals at a casino Shimmering hand (maybe, maybe not)Shimmering hand (maybe, maybe not) Sign language (a complete linguistic communication system)Sign language (a complete linguistic communication system) Aircraft carrier landingsAircraft carrier landings Dog trainingDog training Gambling signals at a casinoGambling signals at a casino

21. Pictograms - 1

22. Pictograms - 2

23. Pictograms - 3

24. Pictograms -4 Pictgram standard MAYON OF LOND ON

25. Pictogram standard MAYON OF LOND ON Pictograms - 5

26. Special Need Group: Divers

27. “Help” “Which direction?” “Boat"

28. Underwater Communications and Hand Signals - 1

29. Underwater Communications and Hand Signals - 2

30. Underwater Communications and Hand Signals - 3

31. ARFF Emergency Hand Signals - 1 Aircraft Rescue and Fire Fighting (ARFF) Communications

32. Recommend Evacuation ARFF Emergency Hand Signals - 2

33. Recommend Stop ARFF Emergency Hand Signals - 3

34. Emergency Contained ARFF Emergency Hand Signals - 4

35. Plane Director Uses Hand Signals to Give Directions to Pilots - 1

36. Plane Director Using Hand Signals - 2

37. Ready for Launch Plane Director Using Hand Signals

38. Complete Final Turn Up (Instructio ns to pilot) Suspend Catapult Operation All Clear or Affirmative Brakes off or Brakes On (Fist clenched = Suspend Operation)

39. I have control. (Taking over from previous controller) Hang Fire (Pilot to hold on until further instructions) Lower Launch Bar or Raise Launch Bar The pilot salutes when ready to launch. The Plane Director returns salute to acknowledge pilot's readiness.

40. ConclusionsConclusions Like poetry, extraordinarily succinctLike poetry, extraordinarily succinct Can be highly Universal, InternationalCan be highly Universal, International -Subject to back cultural misinterpretations Increasingly widespread useIncreasingly widespread use -Olympics -Travel -Commerce Like poetry, extraordinarily succinctLike poetry, extraordinarily succinct Can be highly Universal, InternationalCan be highly Universal, International -Subject to back cultural misinterpretations Increasingly widespread useIncreasingly widespread use -Olympics -Travel -Commerce

41. End Gestures Gestures

42. BOOKMARKBOOKMARK

43. BOOKMARKBOOKMARK