Challenges in Game Intelligence Hey, what is a “challenge in game intelligence?” Better yet, what is the biggest “challenge” for th field of “game intelligence”? (yes, i took the workshop title literally)

Step One: Document the Problem On the Value of Documenting Real Game AI Problems by baylor, independent game miscreant and auditor, project manager, buyer, funding guy and simpleton Workshop: Challenges in Game AIAAAI 2004

What Is baylor’s Game AI Database? Why It Was Started: i was converting my psychology books to a formatted collection of game AI solutions

Matching Law Problem Area: action selection AI Type: decision making, learning (secondary), personality (secondary) Detail Level: mid-level Technique: matching law Assumptions: Options are relatively equal Example Uses: sports: choosing a shot type FPS: choosing a weapon RPG: choosing a spell RTS: choosing a build unit type Explanation RA/RB = b(rA/rB)^s... Variables RA = Rate of response for option A. How often option A is chosen. This is a counter RA/RA+RB = Relative rate of response for option A. rA = Rate of reinforcement for option A. The percentage of time choosing option A has lead to a good result rA/rA+rB = Relative rate of response for option A. b = Response bias. b>1 means prefers Game Example A wizard is 30 meters away from a group of orcs. He has three third level spells he can use - flamestrike, iceblade and stonestorm. Question: which spell should the wizard cast? Assume that the wizard has successfully hit his enemies 3/10 times with flamestrike, 2/4 times with iceblade and 6/7 times with stonestorm. r(flamestrike) = 3/10 = 0.3 (30%) r(iceblade) = 2/4 = 0.5 (50%) r(stonestorm) = 6/7 = 0.86 (86%) relative r(f) =.3/ = 0.18 (18%) relative r(i) =.5/ = 0.30 (30%) relative r(s) =.86/ = 0.52 (52%) So the wizard would cast stonestorm 52% of the time, iceblade 30% and flamestrike 18% Limitations As stated, does not include learning by observation. LBO can be added however Notes Bias and sensitivity are hard coded

What Is baylor’s Game AI Database? Why It Was Started: i was converting my psychology books to a formatted collection of game AI solutions Then: i realized i couldn’t actually name all that many AI problems to solve And that’s baylor’s Game AI database!

What Do We Know? How many AI problems are there? What percent of problems are easy to fix? What are the most important problems? What percent of problems have solutions? Which problems have solutions that are not being used? Is game AI getting better? What game AI solutions exist? What is an AI problem? What is the difference between an AI problem and a bug? ? ?

What Is baylor’s Game AI Database? Why It Was Started: i was converting my psychology books to a formatted collection of game AI solutions Then: i realized i couldn’t actually name all that many AI problems to solve So: i started collecting/sorting/annotating AI problems And that’s baylor’s Game AI database!

BadAI.com - Database Not the important part so we’re going to go fast

BadAI.com - Games reason #20,000,000 why baylor is not allowed to do design

BadAI.com - Reviews

BadAI.com – Image Gallery

BadAI.com – Problem Categories Web page for viewing problem category hierarchy has not been created yet Originally, AI problem categories were not hierarchical. Today, the hierarchy can be any depth but has yet to exceed three levels (see gallery screen for an example)

BadAI.com - Summaries

…and a bunch of other stuff Game AI text book AI tests (objective, repeatable) Examples of designing behavior capture tools and using the output Rants and other slanderous baylor things …and various baylor projects (Virtual DM, avenue of approach recognition, sensory events builder, virtual hustler, player profiling, sparse decision trees, research on third-order feature extraction, bugging people i meet online, pushing people’s buttons, occasionally sleeping, etc.) WWJD

So hey, baylor, what did you find? WWXD

biggest finding: People are DRAMATICALLY over complicating things!!! (really, seriously, it’s true) (sorry, but you AI guys are worse than us psychologists) WWCYFD

also… Pathfinding (good god, solve this already!!!) Data structures - most AI problems are data structure problems, not algorithms Design – most reported AI problems aren’t AI (as i understand it), they’re simple design decisions. AI has become (always was?) a meaningless term Game reviewers have really low standards Academics are waaaay too hung up on theory. “Hey, that’s not a proper implementation of Inveigle’s POMDP TDL algorithm!!!” They should be strangled with their own acronyms Fancy slides with pretty colors are for the weak WWiD

Are there game AI problems? There are a few general problems Navigation → steering → bottleneck Navigation → steering → dynamic obstacles Navigation → steering → static obstacles Navigation → steering → vertical navigation Navigation → tactical → danger avoidance Combat → tactical → initiate unwinnable battle Combat → choose position → block allies Combat → choose position → friendly fire Combat → choose position → move to melee for ranged Combat → choose target → notice new enemy Combat → weapon selection → area affect self/teammates And they’re in many games… Age of Mythology Baldur’s Gate Baldur’s Gate 2 Battlezone Beseiger Call of Duty Ground Control II Half-Life Hidden & Dangerous Icewind Dale Icewind Dale 2 Neverwinter Nights Planescape: Torment Star Wars: Knights of the Old Republic Warlords Battlecry III door bottleneck But not all Beyond Good & Evil Command & Conqueror: Red Alert 2 Ground Control Heretic 2 Hexen 2 Northland Important!!!

Is that a bad thing? Hmm, maybe not After all, people keep buying the games but… A game with good AI might sell better (maybe) And we need better AI for: simulators used for training simulators used for prediction simulators used for decision making simulators used for education Tommy Timeclock says That’s a topic for another day

What are the problems? if a picture is worth a thousand words…

Ravenous Bugblatter Beast of Traal Instance Of: Does not respond to pain More generally: Agent does not process important events Specific Problem: Slave does not “turn on” at appropriate time Trigger Failure Also seen in: Bard’s Tale Doom Heretic Quake Quake 2 SW:KotOR Betrayl at Krondor …but not Delta Force 1 Delta Force 2 Thief Baldur’s Gate Planescape: Torment HM&M IV Note: Only AI gets this wrong Pain is detected and dealt with by the sound, animation and particle systems

Certain AI Problems Appear Over and Over (and over and over) Ally attracts enemies (Baldur’s Gate, *cough* Dikatana *cough*) Ally loses the mission (Delta Force 2, Delta Force: Blackhawk Down) Repeatedly use attacks known not to work (Civilization, all 8 Baldur’s Gate games) Move to point blank range to use ranged weapon (Civilization, DF:BHD, Star Wars: Knights of the Old Republic) Ignore grenades (SW:KotOR, Full Spectrum Command) Don’t react to significant changes such as a new enemy appearing (DF:BHD, Full Spectrum Command, SW:KotOR) Not predicting outcomes, such as what happens when you shoot a rocket launcher into a post 2 feet in front of you or trying to shoot through a mountain (DF:BHD, SW:KotOR) Most of these problems have been solved in other games!!!

Why do we still have these AI problems? Possibilities: These are hard problems! We can’t predict everything a player will do Game AI developers do not AI backgrounds Not enough time Not enough CPU Because no one cares

Excuse 1: These problems are hard! AKA - AI is hard - Building human intelligence is hard

Problem: Allies block you’re only exit, will not move Question: Can this AI problem be solved? “I said, BUMP!!!”

Problem: Allies decide to run in front of a helicopter mounted minigun you have been firing non-stop for two minutes Question: How hard would it be to solve this “AI” problem?

Excuse 2: We can’t find all the problems, there are too many possibilities AKA - Players are unpredictable - We didn’t think to test that - There are too many different items to track - Combinatorial complexity

Five minutes in the life of 2003’s Game of the Year, Star Wars: Knights of the Old Republic Scene: Kashyyyk. Actual shots from baylor and two computer-controlled allies trying to walk 50’, from one end of an alley to the other. The alley has several well-marked, glowing land mines Will they survive this daring maze? Goal: portal

Five minutes in the life of a navigation problem… “OK everyone, watch where you step”

“Jolee, try not to step on that landmi…”

“Hey Bastilla, can you believe Jolee just… Oh, I guess so”

“Bastilla, did you just step on another marked poison gas mine?”

“Jolee!!!”

“Don’t you dare…”

“I hate you guys”

Excuse 2: We can’t find all the problems, contd. How hard would it have been to predict: A monster would be shot? An ally would move while the player held a weapon? Someone would need to walk up stairs or through a door? Someone would throw a grenade? Someone would fire a rocket launcher? Someone would step on one of the 20 land mines we placed in each level? The path to a targets would be blocked? An enemy would move closer to you after a battle had started? If we collected a list of every AI problem reported in a review or on a forum, how many would turn out to have been difficult to predict?

AKA - This is AI and AI people have PhDs - I’m still learning neural networks - I haven’t finished Russel & Norvig - I tried reading AI but couldn’t pronounce  φ∑θπ μ  ΦγΨασω Excuse 3: Lack of formal AI training

“Note to self: Don’t throw grenades at point blank range”

Theory 4: No time! We’re busy!!! AKA -It takes a long time to “create” “AI” -Time is tight and I need to tweak our bump-mapped, b-splined, ambient occluded, UV-mapped pixel shader -Did I mention I’m waiting on an AI co-processor?

The Pond Fish “If anyone tries to invade the swimming pool, we’ll be ready for them!”

Which is older, the game’s AI flaw or its customers?

Theory 5: Not enough CPU time (thanks a lot stupid graphics guys) AKA -An A* search of 1,500,000 nodes takes over a second! -Solving hard problems requires slow, complicated algorithms -I can’t do that with my current data structures -I’m waiting until graphics are no longer important. That’s next year, right? -I’m waiting for the inevitable AI coprocessor Question: How much CPU time is needed?

AI: “We would never accept such a deal!”

Strategic Question: Should i make my agriculture investment in France or Antarctica? Building rail roads increases the value of the land (if the land has value to begin with) and increases unit movement This civilization has several central, irrigated squares it has not yet deployed rail roads to Obvious tile to build on someone else’s sarcasm

Theory 5: Not enough CPU time (contd.) How much processing time is needed to: -Determine 48 is bigger than 47? -Choose between two areas to grow crops, France or Antarctica? -Decide to not step on a land mine? -Decide not to walk into a gun -Determine whether i am in front of an ally firing a gun -Determine if i should use a weapon that hurts the enemy or the one that does not? Can we spare that much time? Maybe if we had an AI coprocessor…

Theory 6: AI isn’t important AI can’t be summarized in a marketing bullet point (e.g., “inverse kinematics”) AI can’t be turned into a pretty box cover or screen shot (e.g., particle effects) No objective benchmark (e.g., frames per second); Reviewers and marketing can’t use for between-game comparisons No feature checklist (e.g., bump mapping, dynamic lighting, MIP-mapping); Reviewers can’t objectively compare games Aside from Black&White, no one has ever bought or avoided game based on its AI No competition; no game has good AI Good AI is invisible. Bad AI is a stupid action that takes the player out of the game. Good AI just means a lack of noticeable stupidity. Selling “lack of stupidity” is like selling “our game is stable”; How many games have sold because of bug count? yet another topic for yet another day

Are these problems solvable? Well, yeah… As seen in previous slides, solutions are often obvious, simple and light weight But are these problems and solutions representative? How do we know baylor didn’t just cherry pick the items that supported his position? That’s a pretty good question (wouldn’t it be nice if we had a way to answer this question?)

Are there already solutions? Yes, in: Existing games CGF research Ethological research Psychological literature Example: Learning (Rescorla-Wagner, Matching Law, biological preparedness, latent learning, S-(R-O), opponent-process theory, learning by observation, Structure Mapping, etc.) Decision Making (Recognition-Primed Decisions, expectation violation, recognition heuristic, Affordance Theory, forward simulation, Elimination By Aspects, Theory of Mind, etc.) Information Gathering (Think Aloud Protocol, behavior capture via video games)

Problems with existing solutions Game programmers are not teachers –Paid to write code, not publish their knowledge –Historically, little information was shared. Much better today ( Charles River, id open source, IGDA, John Laird ) No known place to get basic info –Getting slightly better (AI Programming Wisdom, Game Programming Gems, Gamasutra) Too much bad/useless information –A*, neural networks, genetic algorithms, Russell & Norvig

Classic Problem: Target Selection A lot more interesting than Towers of Cannibal Water Jugs

Opinion: What should we do? Document! (hey, I never promised it’d be fun)

AI Problem (and solution) Database Since I couldn’t find one, I made one It’s an actual database (Access today, looking at SQLite) Plus an image gallery (considering adding animations) Internet searchable Semi-open –Will have user submissions –Will have forum –Might use something like Wiki

Issues Currently run by one person –…who is lazy –…and has too many other projects –…and doesn’t play that many games –…and has the attention span of a caffinated gerbil Currently lacking a home –Hosted on ihatebaylor.com today –Might give it it’s own Web site (BadAI.com domain is open) –Might move to a school Web site (if I can find a school that is dumb enough to take me)

Questions & Answers and comments and yelling and… (looks suspiciously like Mike van Lent)