Student Name Server Utah School of Computing slide 1 Utah School of Computing GesturesGestures CS5540 HCI Rich Riesenfeld Fall 2008 CS5540 HCI Rich Riesenfeld Fall 2008

Student Name Server Utah School of Computing slide 2 Gestures Studies Following Gesture material from: Hand Centered Studies of Human Movement Project, School of Kinesiology, Simon Fraser University, February 1996 Fall 2008

Student Name Server Utah School of Computing slide 3 Gestures-1Gestures-1 Praying (two flat hands up together)Praying (two flat hands up together) Begging (flat hand)Begging (flat hand) Expressing anger (raising a fist)Expressing anger (raising a fist) Derogation (middle finger up)Derogation (middle finger up) Accusation (index pointing)Accusation (index pointing) Live or die decisions in the Roman amphitheater (thumb up/down)Live or die decisions in the Roman amphitheater (thumb up/down) Praying (two flat hands up together)Praying (two flat hands up together) Begging (flat hand)Begging (flat hand) Expressing anger (raising a fist)Expressing anger (raising a fist) Derogation (middle finger up)Derogation (middle finger up) Accusation (index pointing)Accusation (index pointing) Live or die decisions in the Roman amphitheater (thumb up/down)Live or die decisions in the Roman amphitheater (thumb up/down) Fall 2008

Student Name Server Utah School of Computing slide 4 Gestures-2Gestures-2 Hitch hiking (thumb up, hand moving sideways) Fall 2008

Student Name Server Utah School of Computing slide 5 Gestures-3Gestures-3 Legal and business transactions (handshake, judge hammering) Fall 2008

Student Name Server Utah School of Computing slide 6 Gestures-4Gestures-4 Pointing to real and abstract objects and concepts (index, hand) Fall 2008

Student Name Server Utah School of Computing slide 7 Gestures-5Gestures-5 Waving and Saluting Fall 2008

Student Name Server Utah School of Computing slide 8 Gestures-6Gestures-6 Waving and Saluting Fall 2008

Student Name Server Utah School of Computing slide 9 Gestures-7Gestures-7 Finger Counting Thumb often used for 1, esp abroad Fall 2008

Student Name Server Utah School of Computing slide 10 Gestures-8Gestures-8 Fall 2008 I beg of you … I hope so …

Student Name Server Utah School of Computing slide 11 Gestures-9 Fall 2008 Lets hope its true

Student Name Server Utah School of Computing slide 12 Gestures-10Gestures-10 Fall 2008

Student Name Server Utah School of Computing slide 13 Edvard Munch The Scream (c. 1893) Fall 2008

Student Name Server Utah School of Computing slide 14 Pablo Picasso, Guernica (1937) Fall 2008

Student Name Server Utah School of Computing slide 15 Auguste Rodin, The Thinker (1880) Fall 2008

Student Name Server Utah School of Computing slide 16 Auguste Rodin, The Kiss (1888) Fall 2008 Warning: Explicit Body Forms Below. For Mature Eyes Only.

Student Name Server Utah School of Computing slide 17 Gestures-11 Fall 2008

Student Name Server Utah School of Computing slide 18 Gestures-12 Terminate / cut Fall 2008

Student Name Server Utah School of Computing slide 19 Gestures-12 Love (Am Sign Language) Fall 2008

Student Name Server Utah School of Computing slide 20 Gestures-13 Fall 2008 Whoa, stop, … End

Student Name Server Utah School of Computing slide 21 Gestures-14Gestures Trading Floor Hand Signals Fall 2008

Student Name Server Utah School of Computing slide 22 Gestures-15 Fall 2008 juneseptember call put out Trading Floor Hand Signals

Student Name Server Utah School of Computing slide 23 Gestures-16Gestures-16 Conducting an orchestra (variety of both gestures with arms and body)Conducting an orchestra (variety of both gestures with arms and body) Traffic control of cars and airplanes (hands flat pointing or moving)Traffic control of cars and airplanes (hands flat pointing or moving) Shaping of imagined objects (hands tracing out curves and shapes)Shaping of imagined objects (hands tracing out curves and shapes) Martial arts, fighting (variety of movements of arms and body)Martial arts, fighting (variety of movements of arms and body) Conducting an orchestra (variety of both gestures with arms and body)Conducting an orchestra (variety of both gestures with arms and body) Traffic control of cars and airplanes (hands flat pointing or moving)Traffic control of cars and airplanes (hands flat pointing or moving) Shaping of imagined objects (hands tracing out curves and shapes)Shaping of imagined objects (hands tracing out curves and shapes) Martial arts, fighting (variety of movements of arms and body)Martial arts, fighting (variety of movements of arms and body) Fall 2008

Student Name Server Utah School of Computing slide 24 Gestures-17Gestures-17 Dance (Balinese dancing)Dance (Balinese dancing) Gesturing by singers (hand and body movements)Gesturing by singers (hand and body movements) Stock exchange operations (various hand shapes)Stock exchange operations (various hand shapes) Affective gestures (hand touching)Affective gestures (hand touching) Rejective (index up moving left & right) / appreciative (hand clapping) gesturesRejective (index up moving left & right) / appreciative (hand clapping) gestures Dance (Balinese dancing)Dance (Balinese dancing) Gesturing by singers (hand and body movements)Gesturing by singers (hand and body movements) Stock exchange operations (various hand shapes)Stock exchange operations (various hand shapes) Affective gestures (hand touching)Affective gestures (hand touching) Rejective (index up moving left & right) / appreciative (hand clapping) gesturesRejective (index up moving left & right) / appreciative (hand clapping) gestures Fall 2008

Student Name Server Utah School of Computing slide 25 Gestures-18Gestures-18 Game playing (hand signs to communicate with partner in card games)Game playing (hand signs to communicate with partner in card games) Game scoring (cricket, basketball, soccer, rugby, football)Game scoring (cricket, basketball, soccer, rugby, football) Dinner table actions (commanding waiter to refill wine glass)Dinner table actions (commanding waiter to refill wine glass) Positioning of real (remote or close) Control Panel operations (mousing, steering a vehicle)Positioning of real (remote or close) Control Panel operations (mousing, steering a vehicle) Game playing (hand signs to communicate with partner in card games)Game playing (hand signs to communicate with partner in card games) Game scoring (cricket, basketball, soccer, rugby, football)Game scoring (cricket, basketball, soccer, rugby, football) Dinner table actions (commanding waiter to refill wine glass)Dinner table actions (commanding waiter to refill wine glass) Positioning of real (remote or close) Control Panel operations (mousing, steering a vehicle)Positioning of real (remote or close) Control Panel operations (mousing, steering a vehicle) Fall 2008

Student Name Server Utah School of Computing slide 26 Gestures-6Gestures-6 Moving, touching and interacting with objectsMoving, touching and interacting with objects Silent and non-verbal communication (shrugging, holding one's own earlobe, scratching)Silent and non-verbal communication (shrugging, holding one's own earlobe, scratching) Italianate" gestures (two hands open shaking)Italianate" gestures (two hands open shaking) Moving, touching and interacting with objectsMoving, touching and interacting with objects Silent and non-verbal communication (shrugging, holding one's own earlobe, scratching)Silent and non-verbal communication (shrugging, holding one's own earlobe, scratching) Italianate" gestures (two hands open shaking)Italianate" gestures (two hands open shaking) Fall 2008

Student Name Server Utah School of Computing slide 27 Gestures-7Gestures-7 Mimicry and pantomime (actions and objects are depicted with hand/body movements)Mimicry and pantomime (actions and objects are depicted with hand/body movements) sign language (a complete linguistic communication system)sign language (a complete linguistic communication system) Mimicry and pantomime (actions and objects are depicted with hand/body movements)Mimicry and pantomime (actions and objects are depicted with hand/body movements) sign language (a complete linguistic communication system)sign language (a complete linguistic communication system) Mimicry and pantomime (actions and objects are depicted with hand/body movements)Mimicry and pantomime (actions and objects are depicted with hand/body movements) Fall 2008

Student Name Server Utah School of Computing slide 28 Gestures-8Gestures-8 Shimmering hand (maybe, maybe not)Shimmering hand (maybe, maybe not) Sign language (a complete linguistic communication system)Sign language (a complete linguistic communication system) Aircraft carrier landingsAircraft carrier landings Dog trainingDog training Gambling signals at a casinoGambling signals at a casino Shimmering hand (maybe, maybe not)Shimmering hand (maybe, maybe not) Sign language (a complete linguistic communication system)Sign language (a complete linguistic communication system) Aircraft carrier landingsAircraft carrier landings Dog trainingDog training Gambling signals at a casinoGambling signals at a casino Fall 2008

Student Name Server Utah School of Computing slide 29 Pictograms - 1 Fall 2008

Student Name Server Utah School of Computing slide 30 Pictograms - 2 Fall 2008

Student Name Server Utah School of Computing slide 31 Pictograms - 3 Fall 2008

Student Name Server Utah School of Computing slide 32 Pictograms -4 Pictgram standard MAYON OF LOND ON Fall 2008

Student Name Server Utah School of Computing slide 33 Pictogram standard MAYOR OF LOND ON Pictograms - 5 Fall 2008

Student Name Server Utah School of Computing slide 34 Special Need Group: Divers Fall 2008

Student Name Server Utah School of Computing slide 35 Help Which direction? Boat" Fall 2008

Student Name Server Utah School of Computing slide 36 Underwater Communications and Hand Signals - 1 Fall 2008

Student Name Server Utah School of Computing slide 37 Underwater Communications and Hand Signals - 2 Fall 2008

Student Name Server Utah School of Computing slide 38 Underwater Communications and Hand Signals - 3 Fall 2008

Student Name Server Utah School of Computing slide 39 ARFF Emergency Hand Signals - 1 Aircraft Rescue and Fire Fighting (ARFF) Communications Fall 2008

Student Name Server Utah School of Computing slide 40 Recommend Evacuation ARFF Emergency Hand Signals - 2 Fall 2008

Student Name Server Utah School of Computing slide 41 Recommend Stop ARFF Emergency Hand Signals - 3 Fall 2008

Student Name Server Utah School of Computing slide 42 Emergency Contained ARFF Emergency Hand Signals - 4 Fall 2008

Student Name Server Utah School of Computing slide 43 hear this, Fall 2008 Now,

Student Name Server Utah School of Computing slide 44 hear this, Now, Fall 2008

Student Name Server Utah School of Computing slide 45 Aircraft Carrier Deck Operations Fall 2008

Student Name Server Utah School of Computing slide 46 Flight Deck Organization -1 Fall 2008 Aircraft traffic flow using angle deck

Student Name Server Utah School of Computing slide 47 Fall 2008

Student Name Server Utah School of Computing slide 48 Uniform Colors-1 Fall 2008

Student Name Server Utah School of Computing slide 49 Fall 2008

Student Name Server Utah School of Computing slide 50 Uniform Colors-2 Fall 2008 Yellow Shirts:Flight Deck Officers and Plane Directors Green Shirts:Catapult and Arresting Gear people Red Shirts:Aviation ordnance crews. Checker Shirts:Squadron maintenance White Shirts: (w Red Cross): Flight deck medical corpsmen

Student Name Server Utah School of Computing slide 51 Uniform Colors-3 Fall 2008 Blue Shirts:Flight Deck Crew Brown Shirts:Squadron personnel Purple Shirts:Aviation fuels people White Shirts:Mail and people handlers White Shirts: (w Red Cross): Flight deck medical corpsmen

Student Name Server Utah School of Computing slide 52 Plane Director Uses Hand Signals to Give Directions to Pilots - 1 Fall 2008

Student Name Server Utah School of Computing slide 53 Plane Director Using Hand Signals - 2 Fall 2008 Cat video.avi

Student Name Server Utah School of Computing slide 54 Ready for Launch Fall 2008

Student Name Server Utah School of Computing slide 55 Conclusions Like poetry, extraordinarily succinct Can be highly Universal, International -Subject to bad cultural misinterpretations Increasingly widespread use -Olympics -Travel -Commerce Fall 2008

Student Name Server Utah School of Computing slide 56 Utah School of Computing End Gestures Gestures

Student Name Server Utah School of Computing slide 57 BOOKMARKBOOKMARK Fall 2008

Student Name Server Utah School of Computing slide 58 Complete Final Turn Up (Instructio ns to pilot) Suspend Catapult Operation All Clear or Affirmative Brakes off or Brakes On (Fist clenched = Suspend Operation) Fall 2008

Student Name Server Utah School of Computing slide 59 I have control. (Taking over from previous controller) Hang Fire (Pilot to hold on until further instructions) Lower Launch Bar or Raise Launch Bar The pilot salutes when ready to launch. The Plane Director returns salute to acknowledge pilot's readiness. Fall 2008

Student Name Server Utah School of Computing slide 60 BOOKMARKBOOKMARK Fall 2008

Student Name Server Utah School of Computing slide 61 Fall 2008

Student Name Server Utah School of Computing slide 62 Fall 2008

Student Name Server Utah School of Computing slide 63 Fall 2008

Student Name Server Utah School of Computing slide 64 Fall 2008

Student Name Server Utah School of Computing slide 65 Fall 2008