1. Casual Kinect Jean-Francois Prevost Developer Account Manager Microsoft

2. 2 Kinect So Far Announced at E3 2009 Launched in Fall 2010 Guinness World Record as “World’s Fastest Selling Consumer Electronics Device” 18M devices sold

3. Casual Kinect - Agenda Controller Free Gaming Design Considerations The Rules of Kinect Things We’ve Learned Q&A 3

4. Casual Kinect - Agenda Controller Free Gaming Design Considerations The Rules of Kinect Things We’ve Learned Q&A 4

5. 5 Controller Free Gaming

6. 6 RGB CAMERA MULTI-ARRAY MIC MOTORIZED TILT 3D DEPTH SENSORS 3D DEPTH SENSORS

7. 7 Controller

8. 8 Controller – Controller Settings Can Be Daunting! Image courtesy of Penny Arcade.

9. 9 Controller – How Some May See It… Image courtesy of Wikimedia Commons.

10. 10 Controller – My Perception And I love it! …BUT!!!

11. New Experiences And Opportunities! 11

12. Controller Free Gaming – Happy Action Theater 12

13. Casual Kinect - Agenda Controller Free Gaming Design Considerations The Rules of Kinect Things We’ve Learned Q&A 13

14. Design Considerations What do you NEED? –Full Kinect support? My focus for today! –Seated skeletal tracking? –Hybrid support? Forza 4 –Speech only? Mass Effect 3 14

15. Before You Start Kinect design Embrace Kinect! Controller mapping may not be… optimal. Testing Be ready to prototype and test Test early, test often Good intentions are not enough! When testing, sit aside and observe the player You need to explain how to play? Need more work –Adjust the gameplay? Add feedback? 15

16. The Challenge –Can we make virtual interfaces that obviousAre obvious how to operate CommunicateCommunicate what’s happening funAre fast, comfortable and fun for your audience to use workAnd that, actually, you know, work? 16

17. Casual Kinect - Agenda Controller Free Gaming Design Considerations The Rules of Kinect Things We Learned Q&A 17

18. 18 Explain what the player can do. Represent what they are doing. Make it fun to match the two. Test your implementation.

19. 19 Explain what the player can do. Represent what they are doing. Make it fun to match the two. Test your implementation.

20. Explain What The Player Can Do At every moment in the game, explain to the player –what interaction options they have –the effect of each option Choose a clear conceptual model –Does the player immediately understand how to use it? –I know how to drive a car… –… but I don’t know how to fly a dragon 20

21. Explain: What Gestures Are Being Detected? Make it as clear as you can Especially in games with non-obvious gestures –Easier if you’re just copying the guy onscreen –More than 3-4 available gestures? You have a challenge. How do you teach a wider range of moves? –Show animations during loading? In game? –Tutorial at start? Ongoing? On main menu? Optional or not? –Reference guide on pause menu? –Can you redesign gestures to not need tutoring? 21

22. Explain: Where Should The Player Be? Tell the player where to position themselves –Playspace indicator at the start –Bring it up again if they drift –One or two players? Intent to play 22

23. Explain: Are There Voice Controls? Does player know that voice is an option? –Show a microphone option? –When is the game listening? Can the player open the mic selectively? –Say a trigger phrase, like “Xbox...”? What phrases can the player say? –Aim for <10-15 in any one context –Can have many contexts 23

24. Speech Recognition Case Study: VUI Bar Engagement model –Mic indicator for speech-enabled menus –Keyword to engage Teaching user the grammar –“See it, say it”  “Know it, say it” Feedback and confirmation 24

25. A New Way To Explain, In Your Menus pas·si·vate (ps-vt) v. pas·si·vat·ed, pas·si·vat·ing, pas·si·vates v.tr. To perform an instantaneous action on a UI element, that has an instantaneous effect that is non-critical, instantly reversible, but useful – perhaps showing more detail about the effect of that element; as opposed to an action that has a major effect (c.f. activate) passi·vation n. 25

26. Passivation 26 Experience the single-player story You and a friend will repel the invasion together Play exciting minigames You and a friend will repel the invasion together About this mode:

27. Passivation 27

28. 28 Explain what the player can do. Represent what they are doing. Make it fun to match the two. Test your implementation.

29. Represent: The Player’s Movements “Avateering” Video image Augmented Reality 3D depth image Menu pointer ‘Image’ of your hands Indirect (vehicle etc) Limb highlights Etc., etc., etc. 29

30. How To Immediately Fail Your Kinect UI Review 30 WAVE TO START!

31. Represent: Drifting Out Of The Playspace 31 Pause the Game “MOVE BACK!” and show triangle “MOVE FORWARD!” & triangle “MOVE LEFT/RIGHT!” and show triangle Pause the Game

32. 32 Explain what the player can do. Represent what they are doing. Make it fun to match the two. Test your implementation.

33. Make It Fun: Not Just Functional Fun is the goal of every part of your game Avoid frustration, delay and fatigue Think about the physical and time costs of your UI design If “taking inspiration”, understand and improve it 33

34. Get To The Game! Get to the game quickly Avoid unnecessary menus Skippable videos Optional tutorial 34

35. The Fastest UI Of All? 35 +EFIGS + regional dialects + Japanese +Big hit on the dash +Very fast, very cool +Really easy to build -Passivation? -Not all languages -Needs backup?

36. 36 Explain what the player can do. Represent what they are doing. Make it fun to match the two. Test your implementation.

37. User Testing Good intentions are not enough Your UI will have problems Your biggest problems will be easy to find Watching others use your UI will make you a better designer –Your users are not like you 37

38. User Testing To really test your UI… … have someone try your game… … then sit down and don’t talk! Need to explain what to do? Can the player figure out how to navigate? Something’s missing! Need m ore feedback… Odds are the player is right. You may be wrong! 38

39. Remember When demoing your game, You won’t be in their house to demo Let the new player take control Take notes and videos Identify confusion and frustration Identify what works, too! 39

40. 40 Explain what the player can do. Represent what they are doing. Make it fun to match the two. Test your implementation.

41. Casual Kinect - Agenda Controller Free Gaming Design Considerations The Rules of Kinect Things We’ve Learned Q&A 41

42. 42 Things We’ve Learned

43. Making Aim And Hover More Fun 43 Avoid small and/or closely-spaced buttons –If you can’t, be very clear what’s selected Bigger buttons better, but only to a point Consider magnetic or sticky buttons Repeated Accidental Activation Syndrome Make the hover countdown clear –Make it proportional to the “cost” of the button Costly to recover from bad selection? Make it longer. Otherwise feel free to make it shorter, 0.75s can work! Think how passivation can help you

44. 44 Do! Live by The Rules of KINECT –Explain what they should do –Represent what they are doing –Make it fun to match them up –Test your implementation Make cutscenes skippable Speed them to the fun bit Keep the player in the right place Like Totally Do These...

45. 45 Mimicking a controller (go hybrid?) No play without ‘intent to play’ Overloading menu screens Assuming shared lingo Assuming the player has played game X Forcing players to have their photo taken Confusing Avatar’s hand with cursor Boring the player with unnecessary tutorial But These, Not So Much

46. Casual Kinect - Agenda Controller Free Gaming Design Considerations The Rules of Kinect Things We’ve Learned Q&A 46

47. 47 Q&A Questions? Jean-Francois Prevost jprevost@microsoft.com Want to learn more about Kinect? Gamefest Presentations http://www.microsoftgamefest.com/ http://www.microsoftgamefest.com/seattle2011.htm#KINECT/NUI