Introdution We are -What are we going to talk about

Click to edit Master text styles Second level Third level Fourth level Fifth level Anal ysis

Click to edit Master text styles Second level Third level Fourth level Fifth level Anal ysis Elements of winning: – Build Order – Information Gathering – Macro – Micro

Click to edit Master text styles Second level Third level Fourth level Fifth level Anal ysis Terran Tactics – Timing Attack – Pushing – Harassment

Click to edit Master text styles Second level Third level Fourth level Fifth level Anal ysis Unit analysis – Marine – Vulture – Wraiths

Click to edit Master text styles Second level Third level Fourth level Fifth level Bays ian Net wor ks

Click to edit Master text styles Second level Third level Fourth level Fifth level Bays ian Net wor k Choice of decision model – Bayesian Networks – Decision Trees

Click to edit Master text styles Second level Third level Fourth level Fifth level Bays ian Net wor k Spawn Prediction

Click to edit Master text styles Second level Third level Fourth level Fifth level Bays ian Net wor k Threat level prediction – tvt

Click to edit Master text styles Second level Third level Fourth level Fifth level Pote ntial Fiel ds

Click to edit Master text styles Second level Third level Fourth level Fifth level Pote ntial Fiel d In Gen eral Attractive behavior Repulsive behavior From vector to number

Click to edit Master text styles Second level Third level Fourth level Fifth level Our Pote ntial Fiel d Fun ctio n Behavior is determined by + or – due vs de (2de - due)

Click to edit Master text styles Second level Third level Fourth level Fifth level Chan ged Whe n Impl eme ntin g Pote ntial Field All forces are positive Forces are learned

Click to edit Master text styles Second level Third level Fourth level Fifth level Rein forc eme nt Lear ning Generalization of Q-Learning

Click to edit Master text styles Second level Third level Fourth level Fifth level Enviro nment Variabl es Distance to Ally Distance from Current Tile to Ally Distance to Center of Squad Distance from Current Tile to Center of Squad Distance to Enemy Distance from Current Tile to Enemy Distance to Cliff or Edge Distance from Current Tile to Cliff or Edge A State is defined as the combination of all the following characteristics: Number of units Health Lost Damage Dealt Number of Units Time Weapons Cool Down Shooting Range

Click to edit Master text styles Second level Third level Fourth level Fifth level Rein forc eme nt Lear ning

Click to edit Master text styles Second level Third level Fourth level Fifth level Gen erali zati on For mul as Q-Approximation Reward

Click to edit Master text styles Second level Third level Fourth level Fifth level Updati ng Rules

Click to edit Master text styles Second level Third level Fourth level Fifth level Algo rith m Image that im still doing

Click to edit Master text styles Second level Third level Fourth level Fifth level TES T

Click to edit Master text styles Second level Third level Fourth level Fifth level Buil ding a test Figure of StarEdit – a Starcraft BroodWar map editor

Click to edit Master text styles Second level Third level Fourth level Fifth level Bas e cas e Testing without Reinforcement learning, and potential fields

Click to edit Master text styles Second level Third level Fourth level Fifth level Bas e cas e Testing with potential fields, but not reinforcement learning

Click to edit Master text styles Second level Third level Fourth level Fifth level Will it con verg e? Which Alpha and Gamma values? How many iterations is needed?

Click to edit Master text styles Second level Third level Fourth level Fifth level Will it con verg e? Running tests with different values

Click to edit Master text styles Second level Third level Fourth level Fifth level Will it con verg e? Values Alpha 0,2 and Gamma 0,9 (30852)

Click to edit Master text styles Second level Third level Fourth level Fifth level Will it con verg e? Values Alpha 0,4 and Gamma 0,6 (135936)

Click to edit Master text styles Second level Third level Fourth level Fifth level Predict spa wn and buil d ord er

Click to edit Master text styles Second level Third level Fourth level Fifth level Con clusi on