Prologue x2OZYhttp://www.youtube.com/watch?v=XP9cfQ x2OZY.

Slides:



Advertisements
Similar presentations
An Introduction to Game Theory Part V: Extensive Games with Perfect Information Bernhard Nebel.
Advertisements

Introduction to Game Theory
Nash’s Theorem Theorem (Nash, 1951): Every finite game (finite number of players, finite number of pure strategies) has at least one mixed-strategy Nash.
This Segment: Computational game theory Lecture 1: Game representations, solution concepts and complexity Tuomas Sandholm Computer Science Department Carnegie.
Chapter Twenty-Eight Game Theory. u Game theory models strategic behavior by agents who understand that their actions affect the actions of other agents.
Non-Cooperative Game Theory To define a game, you need to know three things: –The set of players –The strategy sets of the players (i.e., the actions they.
Operations Research Assistant Professor Dr. Sana’a Wafa Al-Sayegh 2 nd Semester ITGD4207 University of Palestine.
1 Chapter 14 – Game Theory 14.1 Nash Equilibrium 14.2 Repeated Prisoners’ Dilemma 14.3 Sequential-Move Games and Strategic Moves.
Chapter 6 Game Theory © 2006 Thomson Learning/South-Western.
Chapter 6 Game Theory © 2006 Thomson Learning/South-Western.
An Introduction to... Evolutionary Game Theory
Multiple Criteria Decision Analysis with Game-theoretic Rough Sets Nouman Azam and JingTao Yao Department of Computer Science University of Regina CANADA.
© 2015 McGraw-Hill Education. All rights reserved. Chapter 15 Game Theory.
EC941 - Game Theory Lecture 7 Prof. Francesco Squintani
Game Theory: Inside Oligopoly
EKONOMSKA ANALIZA PRAVA. Game Theory Outline of the lecture: I. What is game theory? II. Elements of a game III. Normal (matrix) and Extensive (tree)
Short introduction to game theory 1. 2  Decision Theory = Probability theory + Utility Theory (deals with chance) (deals with outcomes)  Fundamental.
The Evolution of Conventions H. Peyton Young Presented by Na Li and Cory Pender.
Chapter 6 © 2006 Thomson Learning/South-Western Game Theory.
A camper awakens to the growl of a hungry bear and sees his friend putting on a pair of running shoes, “You can’t outrun a bear,” scoffs the camper. His.
1 Game Theory Lecture 2 Game Theory Lecture 2. Spieltheorie- Übungen P. Kircher: Dienstag – 09: HS M S. Ludwig: Donnerstag Uhr.
Our Group Members Ben Rahn Janel Krenz Lori Naiberg Chad Seichter Kyle Colden Ivan Lau.
10.3 Absorbing Markov Chains
Chapter Twenty-Eight Game Theory. u Game theory models strategic behavior by agents who understand that their actions affect the actions of other agents.
An introduction to game theory Today: The fundamentals of game theory, including Nash equilibrium.
Abstract Though previous explorations of equilibria in game theory have incorporated the concept of error-making, most do not consider the possibility.
Game Theory Here we study a method for thinking about oligopoly situations. As we consider some terminology, we will see the simultaneous move, one shot.
Nash Q-Learning for General-Sum Stochastic Games Hu & Wellman March 6 th, 2006 CS286r Presented by Ilan Lobel.
Chapter 6 Extensive Games, perfect info
An introduction to game theory Today: The fundamentals of game theory, including Nash equilibrium.
TOPIC 6 REPEATED GAMES The same players play the same game G period after period. Before playing in one period they perfectly observe the actions chosen.
PRISONER’S DILEMMA By Ajul Shah, Hiten Morar, Pooja Hindocha, Amish Parekh & Daniel Castellino.
QR 38, 2/22/07 Strategic form: dominant strategies I.Strategic form II.Finding Nash equilibria III.Strategic form games in IR.
Finite Mathematics & Its Applications, 10/e by Goldstein/Schneider/SiegelCopyright © 2010 Pearson Education, Inc. 1 of 60 Chapter 8 Markov Processes.
Simulating Normal Random Variables Simulation can provide a great deal of information about the behavior of a random variable.
DANSS Colloquium By Prof. Danny Dolev Presented by Rica Gonen
UNIT II: The Basic Theory Zero-sum Games Nonzero-sum Games Nash Equilibrium: Properties and Problems Bargaining Games Bargaining and Negotiation Review.
An introduction to game theory Today: The fundamentals of game theory, including Nash equilibrium.
Game Theory Statistics 802. Lecture Agenda Overview of games 2 player games representations 2 player zero-sum games Render/Stair/Hanna text CD QM for.
Game Theory.
Introduction to Game Theory and Strategic Interactions.
Introduction to Game Theory
Reading Osborne, Chapters 5, 6, 7.1., 7.2, 7.7 Learning outcomes
Social Choice Session 7 Carmen Pasca and John Hey.
NOBEL WP Szept Stockholm Game Theory in Inter-domain Routing LÓJA Krisztina - SZIGETI János - CINKLER Tibor BME TMIT Budapest,
Chapter 12 Choices Involving Strategy Copyright © 2014 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written.
A Game-Theoretic Approach to Strategic Behavior. Chapter Outline ©2015 McGraw-Hill Education. All Rights Reserved. 2 The Prisoner’s Dilemma: An Introduction.
Dynamic Games of complete information: Backward Induction and Subgame perfection - Repeated Games -
EC941 - Game Theory Prof. Francesco Squintani Lecture 5 1.
Presenter: Chih-Yuan Chou GA-BASED ALGORITHMS FOR FINDING EQUILIBRIUM 1.
Dynamic Games & The Extensive Form
Game theory & Linear Programming Steve Gu Mar 28, 2008.
Public Policy Analysis MPA 404 Lecture 24. Previous Lecture Graphical Analysis of Tariff and Quota Game Theory; The prisoner's Dilemma.
PHARMACOECONOMIC EVALUATIONS & METHODS MARKOV MODELING IN DECISION ANALYSIS FROM THE PHARMACOECONOMICS ON THE INTERNET ®SERIES ©Paul C Langley 2004 Maimon.
1 What is Game Theory About? r Analysis of situations where conflict of interests is present r Goal is to prescribe how conflicts can be resolved 2 2 r.
Strategic Behavior in Business and Econ Static Games of complete information: Dominant Strategies and Nash Equilibrium in pure and mixed strategies.
An Introduction to Game Theory Math 480: Mathematics Seminar Dr. Sylvester.
Game Theory (Microeconomic Theory (IV)) Instructor: Yongqin Wang School of Economics, Fudan University December, 2004.
Lec 23 Chapter 28 Game Theory.
Econ 805 Advanced Micro Theory 1 Dan Quint Fall 2009 Lecture 1 A Quick Review of Game Theory and, in particular, Bayesian Games.
Goldstein/Schnieder/Lay: Finite Math & Its Applications, 9e 1 of 60 Chapter 8 Markov Processes.
By: Donté Howell Game Theory in Sports. What is Game Theory? It is a tool used to analyze strategic behavior and trying to maximize his/her payoff of.
Game theory basics A Game describes situations of strategic interaction, where the payoff for one agent depends on its own actions as well as on the actions.
Mixed Strategies Keep ‘em guessing.
Game Theory: The Competitive Dynamics of Strategy
Communication Complexity as a Lower Bound for Learning in Games
Learning 6.2 Game Theory.
Molly W. Dahl Georgetown University Econ 101 – Spring 2009
Lecture Game Theory.
Presentation transcript:

Prologue x2OZYhttp:// x2OZY

Truels and N-uels An Analysis

Background: Truels Truels in the Movies: –The Good, The Bad, and The Ugly –Reservoir Dogs –Pulp Fiction –Pirates of the Caribbean Animal Behavior: Three Fierce Animal Rivals living in Proximity, but without significant aggression? Real Showdowns: ABC, NBC, and CBS competition for late night audience.

Past Studies and Our Focus Our first interest in the truel came from the paper: “The Truel” by D. Marc Kilgour and Steven J. Brams. The paper discussed: Sequential (fixed order): The players fire one at a time in a fixed, repeating sequence, such as A,B,C,A,B,C,A... Sequential (random order): The first player to fire, and each subsequent player, is chosen at random among the survivors. Simultaneous: All surviving players fire simultaneously in every round.

An Example and Previous Research Let’s consider one situation in Truels and Nuels : - each player is a perfect shot - each shoots in a sequence.

An Example and Previous Research Taking Turns From 1 Player’s Perspective 1 st Shooter: A A shoots B C can then shoot at A.

An Example and Previous Research However, if A shoots into the air, B’s response should be to eliminate his only threat, C.

Realism: Sequential vs Simultaneous Sequential Please wait your turn to be shot. Some Rules agreed upon for further exploration: Each player prefers an outcome in which he/she survives to one in which he/she does not survive. Players continue to fire until only one survives. Simultaneous: All surviving players fire simultaneously in every round.

Further Exploration  What if they are not perfect shots ?  What if they have more than one shot ?  What if they shoot at the same time ?  Who will a player choose to shoot ? How ?  Is conditional probability a viable tool of analysis ?  What kinds of mathematical tools will we need ?  How will we generalize for use in similar scenarios ?

More Interesting Example 3 Players: A, B, and C (Original Rules Apply) –None are perfect shots. P(A) = 90% P(B) = 70% P(C) = 50% –No shooting in the air. –Simultaneous Results can range from none survive to all survive. {A}, {B}, {C}, {A,B}, {B,C}, {A,C}, {A,B,C}, {Empty Set} More on this later.

Truel Simulation Conditional Probability becomes exponentially more complex. Application Developed to run Truel Simulations Advantages: Configurable Settings -Number of Players -Strategy Used -Number of Full Rounds to Run

Acc1Acc2Acc3Str1Str2Str3Wins1Wins2Wins3None BestBestBest WorstBestBest BestWorstBest WorstWorstBest BestBestWorst WorstBestWorst BestWorstWorst WorstWorstWorst Truel Simulation Key: Acc – Player’s accuracy. Str – Player’s strategy (target best or worst player). Wins –The number of times (out of 10,000) a player survives.

Strategy in Game Theory Definition A strategy function maps every game state to an action to take. For a game with finite states, one can program a response for every game state. Strategies for simultaneous truel. -Shoot the most accurate opponent. -Shoot the least accurate opponent.

Nash Equilibria John Nash (1928- ) developed important game theory concepts. Nash equilibrium – an outcome in which no player can do better by changing strategies. Every game has at least one Nash equilibrium.

Simulation Results Accuracies: A – 90% B – 70% C – 50% AB A A 6.51% B 3.49% C 79.98% A 13.34% B 1.66% C 69.97% C A 39.23% B 4.46% C 15.05% A 82.50% B 0.25% C 1.32% AB A A 3.76% B 82.12% C 1.51% A 17.91% B 33.91% C 4.35% C A 13.88% B 53.47% C 0.31% A 64.54% B 3.63% C 0.04 %

Simulation Results Nash Equilibria exists when no player can do better by unilaterally changing his or her strategy. AB A A 6.51% B 3.49% C 79.98% A 13.34% B 1.66% C 69.97% C A 39.23% B 4.46% C 15.05% A 82.50% B 0.25% C 1.32% AB A A 3.76% B 82.12% C 1.51% A 17.91% B 33.91% C 4.35% C A 13.88% B 53.47% C 0.31% A 64.54% B 3.63% C 0.04 %

Accuracies: A – 90% B – 50% C – 30% Simulation Results AB A A 22.46% B 3.60% C 63.22% A 32.82% B 1.88% C 50.63% C A 56.19% B 2.65% C 15.24% A 83.30% B 0.21% C 1.45% AB A A 14.89% B 66.19% C 1.69% A 30.47% B 36.39% C 2.53% C A 33.10% B 33.50% C 0.39% A 63.47% B 3.48% C 0.08%

Simulation Conclusions These are the only 3 possible equilibria. If both opponents shoot at you, you’ll want to shoot the better one first If your opponents shoot at each other, you’ll still want to shoot the better one first. We can eliminate five outcomes based on this logic.

Further Examples: Finite Bullets 3 Players: A, B, and C (Original Rules Apply) –None are perfect shots. P(A) = 100%Bullets: 1 P(B) = 70%Bullets: 2 P(C) = 30% Bullets: 6 –No shooting in the air. –Simultaneous

Markov Chains A has 1 bullet and shoots at B B has 2 bullets and shoots at A C has 6 bullets shoots at A Each player shoots their most accurate opponent

Markov Chains Player A has no more bullets Player B has 1 bullet left Player C has 5 bullets left

Markov Chains Player A has no more bullets Player B has no more bullets Player C has 4 bullets left

Markov Chains Player A has 1 bullet and 100% accuracy Player B has 2 bullets and 70% accuracy Player C has 6 bullets and 30% accuracy Each player shoots the most accurate opponent.

Markov Chains Player A has 1 bullet and 100% accuracy Player B has 2 bullets and 70% accuracy Player C has 6 bullets and 30% accuracy Each player shoots the opponent with the most bullets.

Absorbing Markov Chains Absorbing Markov Chains have states that once entered cannot be changed. Canonical form of a Markov Chain We can see in the matrix below how the transition matrix is built from four other matrices. Q is the matrix that represents probability of transition from one transitive state to another R is the matrix representing the possibility of changing from a transitive state to an intransitive state. 0 is the zero matrix and I is the Identity matrix. TransitiveIntransitive TransitiveQR Intransitive0I

Absorbing Markov Chains Canonical form of a Markov Chain There exists a Fundamental Matrix, N, which gives us the expected number of times the process is in a transient state given an initial transient state. This is derived by taking the inverse of ( I – Q ), which is the infinite geometric series in matrix form. By multiplying this by R, we can find the probability of entering an intransitive state from a transitive state. This is exactly what we need to fill a payoff matrix. TransitiveIntransitive TransitiveQR Intransitive0I

Absorbing Markov Chains Let’s take matrix T1 from earlier, where all players had bullets, and assume they all have infinite bullets. Then we break it down into our submatrices:

Absorbing Markov Chains We’ll apply the accuracies A – 80% B – 50% C – 30%

Complexity of Markov chains We want to find the number of cells which aren’t guaranteed to be zero or one. Certain states can’t be reached from others. Any nuel devolves into an (n-1)-uel Using counting techniques we find the expression For n of at least 6, this is approximated by

Conclusions for Markov Chains  Markov chains are better for mathematical analysis.  They are not as easily computer-generated as computer simulations.  They have some patterns which may yield more results.

Complexity of Payoff Matrices Each Nuel has a payoff matrix which is n dimensions by (n-1)! entries This means that a nuel has a payoff matrix with entries. Given a set of probabilities, we are not sure if this is NP complete.

Future Research Investigate patterns in R and Q matrices Research generating transition matrices Find practical applications of theory

Acknowledgements We would like to give a special thanks to Dr. Derado for his guidance during the project.