Presentation on theme: "Chapter 15- Game Theory: The Mathematics of Competition"— Presentation transcript:
1 Chapter 15- Game Theory: The Mathematics of Competition Presented by: Katherine Goulde
2 Chapter 15 Outline Introduction Two-Person Total Conflict Games: Pure StrategiesTwo-Person Total Conflict Games: Mixed StrategiesPartial Conflict GamesLarger GamesExtensive Form Games: A sequence of movesApplications of Game Theory
3 First let’s play a little game… Tic- Tac-Toe!!!!- 2 teams- one is ‘X’, the other is ‘O’-random draw decide order- winner gets 3 in a rowWhat strategies did you use?What was your thought process on each move??What was your goal for the game?
4 Introduction- Definitions Strategy: one of the courses of action a player can choose in a game; strategies are mixed or pure, depending on whether they are selected in a randomized fashion or notIt describes the complete course of action in a gameRational Choice: a choice that leads to a preferred outcomeTotal Conflict: a zero-sum or constant-sum game, in which what one player wins the other player losesPartial Conflict: a variable-sum game in which both players can benefit by cooperation but may have strong incentives not to cooperate
5 Two-person Total Conflict Game: Pure Strategies Let’s say 2 people (Sally and Bob) are trying to decided on the location of a restaurant near an intersection.Bob wants a higher elevation; Sally wants a lower elevation.Since they need an intersection, they must decide on a east-west highway and a north-south highway.Sally will choose from the 3 the N-S highways; Bob will choose the 3 E-W highways.
6 Two-person Total Conflict Game: Pure Strategies East- West HighwaysNorth-South Highways123A1046B59C7The numbers in the chart represent altitude in thousands of feet.It shows the altitudes at all 9 possible intersections.A higher number is better for Bob and therefore worse for Sally. (Note-In game theory notation, the payoff matrix in a zero-sum game will always be in terms of the row player)Sally will choose 1, 2, or 3 and Bob will choose A, B, or C
7 Two-person Total Conflict Game: Pure Strategies Bob wants to get the highest altitude, no matter what route Sally choosesBob is going to look at the minimum of each possible choice.For A, the minimum is 4For B, the minimum is 5For C, the minimum is 2.The largest of these is 5. Therefore Bob can choose route B, and guarantee an altitude of at least 5,000 feet.
8 Two-person Total Conflict Game: Pure Strategies Sally wants the lowest altitude, no matter what Bob chooses.Sally is going to look at the maximum for each possible choiceFor choice 1, the maximum is 10.For choice 2, the maximum is 5.For choice 3, the maximum is 9.The smallest of these is choice 2. So Sally can guarantee an altitude of 5,000 feet by choosing Highway 2.
9 Two-person Total Conflict Game: Pure Strategies So Bob chooses B and Sally chooses 2, and they locate their restaurant on a location with an altitude of 5,000 feet.Bob strategy was to find the ‘maximin’, and Sally’s strategy was to find the ‘minimax’.The resulting outcome for the couple is called a ‘saddlepoint’.
10 Two-person Total Conflict Game: Pure Strategies Maximin: In a two-person zero-sum game, the largest of the minimum payoffs in each row of a payoff matrixMaximin strategy: the pure strategy of the row player corresponding to the maximin in a payoff matrixMinimax: In a two-person, zero-sum game, the smallest of the maximum payoffs in each column of a payoff matrixMinimax strategy: the pure strategy of the column player corresponding to the minimax in a payoff matrix.Saddlepoint: In a two-person constant-sum game, the payoff that results when a row minimum and a column maximum are the same, which is the value of the game (it is also a Nash equilibrium)Value: The best outcome that both players can guarantee in a two-person zero-sum game. If there is a saddlepoint, this is the value. If not, it is the expected payoff using mixed strategies
11 What if we changed the game??? What if a terrible storm came through and highways B and 2 were permanently closed??E-W HighwaysNorth-South Highways13A106C27Bob must choose either A or C. He will use the maximin strategy.Sally must choose either 1 or 3. She will use the minmax strategy.What route will Bob choose? What route will Sally choose?Bob will choose A. Sally will choose 3. The value is 6,000 feet.Is this a saddlepoint?No, because the maximin does not equal the minimax.
12 Two-person total conflict game: Mixed strategies Matching Pennies Game!Rules:There are two players, and each throws a penny which will be either heads or tails.If they match, player 1 receives both coinsIf they don’t match, player 2 receives both coinsBefore we play, let’s construct a payoff matrix.Player 2HeadsTailsPlayer 11-1
13 Matching Pennies What were your strategies? Did you have any? It would be pointless for one player to try to outguess the other; therefore one should use mixed strategies.If we think about it probabilistically, how often should player 1 choose heads? How often for tails?What about for player 2?
14 Matching Pennies (pH, pT) = (p1, p2) = (p, 1-p) = (0.5, 0.5) The best that Player 1 can do is randomly select Heads half the time and Tails half the time.(pH, pT) = (p1, p2) = (p, 1-p) = (0.5, 0.5)Then Player 1’s expected value is:EH = 0.5 (1) (-1) = 0 when player 2 plays headsET = 0.5 (-1) (1) = 0 when player 2 plays tailsTherefore zero is Player 1’s mixed strategy valueSimilarly, Player 2’s optimal mixed strategy is a mix, which gives an expected value of zero.This game is fair: its value is 0, and it favors neither player when at least one player uses an optimal strategyNote*-When using mixed strategies, the opponent doesn’t know what the other will pick in any given play. This aspect of the game is random.
15 Nonsymmetrical Game in Mixed Strategies Player 2HeadsTailsPlayer 15-31Nonsymmetrical game: A two-person constant sum game in which the row player’s gains are different from the column player’s gains, except when there is a tieLet’s look at this in mixed strategies.Let ‘p’ be the probability that Player 1 chooses Heads, and ‘1-p’ be the probability that Player 1 chooses Tails.Let ‘q’ be the probability that Player 2 chooses Heads, and ‘1-q’ be the probability that Player 2 chooses Tails.
16 Nonsymmetrical Game in Mixed Strategies Player 2HeadsTailsPlayer 15-3p11-pq1-qThen Player 1’s expected payoff is:EH= 5(p) + (-3)(1-p) assuming that Player 2 plays HeadsET = (-3)p + 1(1-p) assuming that Player 2 plays TailsAnd Player 2’s expected payoff is:EH = (-5)q + (3)(1-q) assuming that Player 1 plays HeadsET = 3q + (-1)(1-q) assuming that Player 1 plays Tails
17 Nonsymmetrical Game in Mixed Strategies Let’s look at Player 1 first.There are two ways to think about it:1) What is the best that Player 1 can do, regardless of player 2’s choiceIn this case, Player 1 will want both of the expected values to be equal,so that he receives the same no matter what player 2 chooses.So EH = ET.5(p) + (-3)(1-p) = (-3)p + 1(1-p)12p = 4p = 1/3Heads will be chosen 1/3 of the time and Tails 2/3 of the time. This guarantees an expected payoff of -1/3
18 Nonsymmetrical Game in Mixed Strategies There is a second way to look at it.The best that Player 1 can do is to make Player 2 indifferent between heads and tails.So, Player 2’s payoffs are equal. EH = ET.But how can Player 1 affect 2’s payoffs? Express them in terms of p.The expected value of 2 choosing Heads is:-5p + 3(1-p)The expected value of 2 choosing Tails is:3p + (-1)(1-p)Set them equal to each other and we get p= 1/3. We can plug in to find the expected payoff for player 2.
19 Nonsymmetrical Game in Mixed Strategies So Player 1 chooses Heads 1/3 of the time and Tails 2/3 of the time.Player 2 equivalently will choose Heads 1/3 of the time and Tails 2/3 of the time.The expected payoff for Player 1 is -1/3The expected payoff for Player 2 is 1/3.This was a zero-sum game: one in which the payoff to one player is the negative of the corresponding payoff to the other, so the sum of the payoffs is always zero.What would happen if we varied from the optimal solution???
20 Partial Conflict Games In the real world, not every player’s loss is another player’s gain. For example, both may benefit or both may lose.Games of partial conflict are variable-sum games, in which the sum of payoffs to the players at the different outcomes varies.Now, let’s play another game!!
21 Partial- Conflict Game Team AwesomeStrategy AStrategy BTeam All-StarStrategy 1(2,2)(4,1)Strategy 2(1,4)(3,3)In this case, both teams have Dominant Strategies.Dominant Strategy- a strategy that is sometimes better and never worse for a player than every other strategy, whatever strategies the other players chooseThe dominant strategies are Strategy 1 and Strategy A. This leads to a special type of game called the Prisoner’s Dilemma.Prisoner’s Dilemma- a 2-person variable sum symmetric game in which each player has two strategies, cooperate or defect. Cooperate dominates defect for both players, even though the mutual-defection outcome, which is the unique Nash equilibrium, is worse for both players than the mutual-cooperation outcome. (note*- the outcome may change in repeated play) Real-world example: Arms raceNash Equilibrium- strategies associated with an outcome such that no player can benefit by choosing a different strategy, given that the other players do not depart from their strategies.
22 Partial-Conflict Games Let’s play another type of game!!
23 Partial- Conflict Game Toyz-R-Our-ThingDon’t ReleaseRelease EXTERM. 3000Kool Toyz(3,3)(2,4)(4,2)(1,1)This game is an example of a type of game called Chicken.Chicken: a two-person, variable-sum symmetric game in which each player has two strategies: to swerve to avoid a ‘collision’ or not to swerve if the other swerves. Neither player has a dominant strategy; the compromise outcome in which both players swerve, is not a Nash equilibrium.What are the Nash equilibrium? Why?Real-world applications: labor-management disputes, international crises
24 Larger GamesThese simultaneous choice games can be extended to more than 3 players and more than 3 choices.We use the concepts of dominant and dominated strategies to reduce the game to a manageable size.Dominated strategy: a strategy this is sometimes worse and never better for a player than some other strategy, whatever strategies the other players chooseIn larger games, there may not be just one solution, but instead many Nash equilibria.
25 Larger Games: ExampleLets say that three women want to start a public garden. If one contributes, the garden will be small. If two contribute, the garden will be medium. If all three contribute, the garden will be large. If none contribute, there will be no garden.No matter if a player contributes or not, she will be allowed to enjoy the garden.Given the cost and benefits of the garden, each player ranks the outcomes as follows (in decreasing order):The others contribute and she does notAll three contribute1 player contributes, the other doesn’t, and she does notShe contributes, another contributes, and the 3rd does notAll three don’t contributeShe contributes and no one else does
26 Larger Games: Example Player 3 contributes Player 3 doesn’t contribute Don’tPlayer 15, 5, 53, 6, 36, 3, 34, 4, 1Player 2ContributeDon’tPlayer 13, 3,61, 4, 44, 1, 42, 2, 2Does Player 1 have a dominant strategy?Does Player 2 have a dominant strategy?Does Player 3 have a dominant strategy?Each player has a dominant strategy not to contribute, which leads to a pure-strategy equilibrium.Also a Nash Equilibrium.Can be found using cell-by-cell inspection.What type of simultaneous game is this?
27 Extensive Form Games: Game Trees Sometimes, the game may not be ‘simultaneous choice’ but instead of sequence of choices (these are called sequential move games and are often modeled using a game tree)The game tree is referred to as the extensive form of the game.Node: the point from which a branch emergesInitial node (or root): the first node in the gameDecision node: represents a point where action is takenTerminal node: the last node along each pathBranches: represents one action that can be taken at that node
28 Extensive Form Games: Game Trees Let’s say there are 2 monkeys and 1 tree with 5 bananas. There is a Big Monkey and a Little Monkey. One monkey will move first, then the other after.
29 Extensive Form Games: Game Trees Let’s use Backwards Induction to solve this.
30 Extensive Form Games: Game Trees What are little monkey’s strategies??Climb if Big Monkey climbsClimb if Big Monkey doesn’t climb.What are Big Monkey’s Strategies?Always Climb.What is the resulting payoff??Would this change if we changed the order??
31 Extensive Form Games: Game Trees When all players choose their optimal strategies found by doing rollback analysis, we call this set of strategies the rollback equilibrium of the gameGame trees can be used for many players with many possible choices.Tic tac toe, for example, could be modeled in a game tree. (a very very large one)What are some other sequential move games??Ex: campaigning in states and elections could be modeled
32 DiscussionWhat do you think of the different type of games? (simultaneous choice, zero-sum, pure/mixed strategies, prisoner’s dilemma, chicken, extensive form)Where do you see applications of these? In politics? The military? In the classroom? In relationships? In sports?What might be some impractical assumptions of game theory? Regarding rational choice, or perfect knowledge?Homework: 7th edition- pg585 #15, pg 587 #23