1. Improving Gameplay: Characterising Differences between NPCs & Human Players Jennifer Sandercock

2. Outline Introduction Testing Methods Characteristics of Bots and Humans Playing vs. Observing Characteristics and Accuracy The Future Conclusions Questions

4. Bot or Human? Lauren www.unrealtournament.com

5. Bot or Human? Lauren www.unrealtournament.com

6. Bot or Human? Lauren www.unrealtournament.com

7. Outline Introduction Testing Methods Characteristics of Bots and Humans Playing vs. Observing Characteristics and Accuracy The Future Conclusions Questions

9. ?????? Study 1: Quake III ?

11. Study 2: Unreal Tournament 2004 ???? Case 1: Playing

12. Study 2: Unreal Tournament 2004 ????? Case 2: Observing

13. Study 2: Unreal Tournament 2004 PlayingObserving

14. Passing the Turing Test?

15. Bot or Human? Renegade www.unrealtournament.com

16. Bot or Human? Renegade www.unrealtournament.com

17. Bot or Human? Renegade www.unrealtournament.com

18. Outline Introduction Testing Methods Characteristics of Bots and Humans Playing vs. Observing Characteristics and Accuracy The Future Conclusions Questions

20. Characteristics of Bots & Human Players Categories Skill Level Personality Persistence & Vengeance Anticipation Learning Teaming Bot limitations and advantages

21. Characteristics least used PlayingObserving 1.Ability to learn from watching others 1.Similarity to known avatar (Bot) personality 2.Similarity to known avatar (Bot) personality 2.Ability to learn from watching others 3.Use of warning shots 4.Number of suicides4.Exploration of the entirety of the terrain 5.Knowledge of exact location of PowerUps 5.Always uses the same waypoint as an attack point

22. Characteristics most used PlayingObserving 1.Easy/hard to kill1.Direction of normal movement (e.g. always runs forwards) 2.Amount of movement during firing 3.Number of kills3.Amount of movement throughout entire game (e.g. stands still lots) 4.Aim Accuracy4.Ability to perform multiple tasks (e.g. jumping and firing simultaneously) 5.Amount of movement throughout entire game (e.g. stands still lots) 5.Movement through terrain: creative paths vs. erratic in a predictable way

24. Bot or Human? Romulus www.unrealtournament.com

25. Bot or Human? Romulus www.unrealtournament.com

26. Bot or Human? Romulus www.unrealtournament.com

27. Outline Introduction Testing Methods Characteristics of Bots and Humans Playing vs. Observing Characteristics and Accuracy The Future Conclusions Questions

28. Playing vs. Observing: Confidence Playing Observing

29. Playing vs. Observing: Accuracy Observing Playing

31. Bot or Human? Rylisa www.unrealtournament.com

32. Bot or Human? Rylisa www.unrealtournament.com

33. Bot or Human? Rylisa www.unrealtournament.com

34. Outline Introduction Testing Methods Characteristics of Bots and Humans Playing vs. Observing Characteristics and Accuracy The Future Conclusions Questions

35. Accurate Playing Characteristics When playing, people who got high accuracy rated the following as important:  Ability to strafe  Movement during firing

36. Inaccurate Observing Characteristics When observing, people who got low accuracy rated the following as important:  Use of sniping positions  Number of suicides  Persistence to kill & to chase  Number of kills  Position during firing  Ability to see behind  Ability to react to being fired upon

37. Accurate Bot Characteristics When playing, people who got high accuracy rated the following as important:  Amount of movement during firing  Direction of normal movement (eg always runs forwards)  Ability to perform multiple tasks (eg jumping & firing simultaneously)  Types of weapons used  Movement through terrain: creative paths vs erratic in a predictable way  Movement to points in the room already traversed  Priority to obtain PowerUps when entering rooms  Ability to see behind their avatar  Ability to react to being fired upon

38. Inaccurate Human Characteristics When observing, people who got low accuracy rated the following as important:  Movement through terrain: creative paths vs erratic in a predictable way  Interesting to watch  Similarity of mistakes (eg always falls off a ledge at a given point)  Exploration of the entirety of the terrain

40. Bot or Human? Virus www.unrealtournament.com

41. Bot or Human? Virus www.unrealtournament.com

42. Bot or Human? Virus www.unrealtournament.com

43. Outline Introduction Testing Methods Characteristics of Bots and Humans Playing vs. Observing Characteristics and Accuracy The Future Conclusions Questions

45. Bot or Human? Brock www.unrealtournament.com

46. Bot or Human? Brock www.unrealtournament.com

47. Bot or Human? Brock www.unrealtournament.com

48. “Getting Games and Military Simulations to Play Together” Jennifer Sandercock & Michael Papasimeon Friday 2:30pm Latrobe Theatre, Level 2

49. Questions?