1 Economics & Evolution Number 2. 2 Reading List.

Slides:



Advertisements
Similar presentations
29 Nov 2010Artificial Life lecture 161 Game Theory: Evolution of Communication Artificial Life methods are used to model and synthesise and understand.
Advertisements

HEA STEM 2014 Understanding evolutionarily stable strategies: interactive games in the classroom Catherine Dennis.
News and Notes 4/13 HW 3 due now HW 4 distributed today, due Thu 4/22 Final exam is Mon May 3 11 AM Levine 101 Today: –intro to evolutionary game theory.
Math Intro: Matrix Form Games and Nash Equilibrium.
Evolution Matt Keeling MA 999: Topics in Mathematical Modelling Tuesday Thursday 2-4.
Ultimatum Game Two players bargain (anonymously) to divide a fixed amount between them. P1 (proposer) offers a division of the “pie” P2 (responder) decides.
Mixed Strategies CMPT 882 Computational Game Theory Simon Fraser University Spring 2010 Instructor: Oliver Schulte.
Evolution and Repeated Games D. Fudenberg (Harvard) E. Maskin (IAS, Princeton)
Defender/Offender Game With Defender Learning. Classical Game Theory Hawk-Dove Game Hawk-Dove Game Evolutionary Stable Evolutionary Stable Strategy (ESS)
1 Evolution & Economics No Evolutionary Stability in Repeated Games Played by Finite Automata K. Binmore & L. Samuelson J.E.T Automata.
Congestion Games with Player- Specific Payoff Functions Igal Milchtaich, Department of Mathematics, The Hebrew University of Jerusalem, 1993 Presentation.
The Evolutionary Games We Play Psychology Introduction Animals tend to behave in ways that maximize their inclusive fitness Usually pretty straightforward.
Joint Strategy Fictitious Play Sherwin Doroudi. “Adapted” from J. R. Marden, G. Arslan, J. S. Shamma, “Joint strategy fictitious play with inertia for.
An Introduction to... Evolutionary Game Theory
Eponine Lupo.  Questions from last time  3 player games  Games larger than 2x2—rock, paper, scissors  Review/explain Nash Equilibrium  Nash Equilibrium.
MIT and James Orlin © Game Theory 2-person 0-sum (or constant sum) game theory 2-person game theory (e.g., prisoner’s dilemma)
EC3224 Autumn Lecture #04 Mixed-Strategy Equilibrium
The Structure of Networks with emphasis on information and social networks T-214-SINE Summer 2011 Chapter 7 Ýmir Vigfússon.
Social Behavior & Game Theory Social Behavior: Define by Economic Interaction Individuals Affect Each Other’s Fitness, Predict by Modeling Fitness Currency.
The Structure of Networks
Learning in games Vincent Conitzer
What is a game?. Game: a contest between players with rules to determine a winner. Strategy: a long term plan of action designed to achieve a particular.
Maynard Smith Revisited: Spatial Mobility and Limited Resources Shaping Population Dynamics and Evolutionary Stable Strategies Pedro Ribeiro de Andrade.
Prisoner’s dilemma TEMPTATION>REWARD>PUNISHMENT>SUCKER.
1 Evolution & Economics No. 5 Forest fire p = 0.53 p = 0.58.
An Introduction to Game Theory Part I: Strategic Games
Satisfaction Equilibrium Stéphane Ross. Canadian AI / 21 Problem In real life multiagent systems :  Agents generally do not know the preferences.
Algoritmi per Sistemi Distribuiti Strategici
Review of Yale Lectures 1 and 2 What is a strictly dominated strategy? Why should you never play one? Why do rational choices sometimes lead to poor decisions?
Yale 11 and 12 Evolutionary Stability: cooperation, mutation, and equilibrium.
A Memetic Framework for Describing and Simulating Spatial Prisoner’s Dilemma with Coalition Formation Sneak Review by Udara Weerakoon.
More on Extensive Form Games. Histories and subhistories A terminal history is a listing of every play in a possible course of the game, all the way to.
Game Problems. Which number is closest to the circumference of the earth? A) 15,000 miles B) 25,000 miles C) 35,000 miles D) 45,000 miles E) 55,000 miles.
Communication Networks A Second Course Jean Walrand Department of EECS University of California at Berkeley.
The Price Of Stability for Network Design with Fair Cost Allocation Elliot Anshelevich, Anirban Dasgupta, Jon Kleinberg, Eva Tardos, Tom Wexler, Tim Roughgarden.
XYZ 6/18/2015 MIT Brain and Cognitive Sciences Convergence Analysis of Reinforcement Learning Agents Srinivas Turaga th March, 2004.
Evolution of Virulence Matthew H. Bonds The François-Xavier Bagnoud Center for Health and Human Rights Harvard School of Public Health Partners in Health.
Introduction to Game Theory Yale Braunstein Spring 2007.
1 Economics & Evolution. 2 Cournot Game 2 players Each chooses quantity q i ≥ 0 Player i’s payoff is: q i (1- q i –q j ) Inverse demand (price) No cost.
CPS Learning in games Vincent Conitzer
Tom Wenseleers Dept. of Biology, K.U.Leuven
Social Choice Session 7 Carmen Pasca and John Hey.
5. Alternative Approaches. Strategic Bahavior in Business and Econ 1. Introduction 2. Individual Decision Making 3. Basic Topics in Game Theory 4. The.
A Game-Theoretic Approach to Strategic Behavior. Chapter Outline ©2015 McGraw-Hill Education. All Rights Reserved. 2 The Prisoner’s Dilemma: An Introduction.
3.1. Strategic Behavior Matilde Machado.
Derivative Action Learning in Games Review of: J. Shamma and G. Arslan, “Dynamic Fictitious Play, Dynamic Gradient Play, and Distributed Convergence to.
Learning in Multiagent systems
Schuster et al., J Biol Phys 34:1–17 (2008) Hadas Zur Computational Game Theory Project 2012.
1 Economics & Evolution Number 3. 2 The replicator dynamics (in general)
Presenter: Chih-Yuan Chou GA-BASED ALGORITHMS FOR FINDING EQUILIBRIUM 1.
Game Theory: introduction and applications to computer networks Game Theory: introduction and applications to computer networks Introduction Giovanni Neglia.
Ken Binmore Origins of Fair Play.
2008/01/30Lecture 11 Game Theory. 2008/01/30Lecture 12 What is Game Theory? Game theory is a field of Mathematics, analyzing strategically inter-dependent.
Section 2 – Ec1818 Jeremy Barofsky
1 What is Game Theory About? r Analysis of situations where conflict of interests is present r Goal is to prescribe how conflicts can be resolved 2 2 r.
Vincent Conitzer CPS Learning in games Vincent Conitzer
ECO290E: Game Theory Lecture 3 Why and How is Nash Equilibrium Reached?
Replicator Dynamics. Nash makes sense (arguably) if… -Uber-rational -Calculating.
Simulating Evolution Robbie Rosati
Game Theory and Cooperation
Replicator Dynamics.
Nash Equilibrium A strategy combination (a,b) is a Nash equilibrium for two players if neither player would unilaterally deviate if he expected the other.
15.3 PDQ.
Economics & Evolution Number 2.
Economics & Evolution.
Vincent Conitzer Learning in games Vincent Conitzer
Module 3.3 Constrained Growth
SURVIVAL OF THE FITTEST
Vincent Conitzer CPS Learning in games Vincent Conitzer
Phase transitions to cooperation in the prisoner‘s dilemma
Presentation transcript:

1 Economics & Evolution Number 2

2 Reading List

3

4 AB A 0, 23, 0 B 2, 11, An Example (B, A ) (B, B ) (A, B ) (A, A ) time is spent in each quadrant

5 AB A 0, 23, 0 B 2, 11, An Example (B, A ) (B, B ) (A, B ) (A, A ) time is spent in each quadrant

6 AB A 0, 23, 0 B 2, 11, An Example (B, A ) (B, B ) (A, B ) (A, A ) time spent in the first quadrant analogously:

7 AB A 0, 23, 0 B 2, 11, An Example (B, A ) (B, B ) (A, B ) (A, A ) time spent in the second quadrant And at t 2 :

8 AB A 0, 23, 0 B 2, 11, An Example (B, A ) (B, B ) (A, B ) (A, A ) time spent in the second quadrant (slide 2) (slide 4) Spending the same time in each quadrant

9 Fictitious Play: Failure to Converge An example by L. Shapley LCR T0, 00, 11, 0 M 0, 00, 1 B 1, 00, 0 The only Nash equilibrium is (⅓, ⅓, ⅓)

10 Fictitious Play: Failure to Converge An example by L. Shapley LCR T0, 00, 11, 0 M 0, 00, 1 B 1, 00, 0 T p 1 =1 M p 2 =1 B p 3 =1 L C R L q 1 =1 C q 2 =1 R q 3 =1 T M B History of player 1 (in player’s 2 mind) History of player 2 (in player’s 1 mind) Best Response of 2 Best Response of 1 The process does not converge, (spends longer periods in any part)

11 Fictitious Play: Failure to Converge An example by L. Shapley LCR T0, 00, 11, 0 M 0, 00, 1 B 1, 00, 0 T p 1 =1 M p 2 =1 B p 3 =1 L C R L q 1 =1 C q 2 =1 R q 3 =1 T M B History of player 1 (in player’s 2 mind) History of player 2 (in player’s 1 mind) Best Response of 2 Best Response of 1 They (almost) always play either (0,1) or (1,0)

12 Fictitious Play: Failure to Converge An example by L. Shapley LCR T0, 00, 11, 0 M 0, 00, 1 B 1, 00, 0 T p 1 =1 M p 2 =1 B p 3 =1 L C R L q 1 =1 C q 2 =1 R q 3 =1 T M B History of player 1 (in player’s 2 mind) History of player 2 (in player’s 1 mind) Best Response of 2 Best Response of 1 Exercise: What happens when they start at the following points ???

13 A proof of the non convergence of Fictitious Play in the Shapley game. Monderer, Samet, Sela: ‘Belief Affirming in Learning Processes’ JET, vol 73, April 1997

14 etc. ex anteex post

15 If the process converges it must be that: Impossible !!!! So the process cannot converge.

16 A Social Interpretation to Fictitious play dynamics Two populations of size N, meet at random and play a 2X2 game. At time t, p(t) of the first population play the second strategy [ q(t) for the second population] Players die and are replaced by new ones. The newly born learn to play the best response against the other population at the time of their birth.

17 AB A 0, 23, 0 B 2, 11, 3 The game: (same as in the previous fictitious game example)

18 AB A 0, 23, 0 B 2, 11, 3 q 0 1 (A) (B) (A) p 1 (B) As long as ( p(t), q(t) ) i s in the first quadrant, the best responses are: ( B, A ).

19

20

21 The Replicator Dynamics and Evolutionarily Stable Strategies E.S.S. Replicator: gene, phenotype It replicates, according to how well it did. It determines the behaviour, the strategy. The replicators play, replicate and then die so that the population remains of a fixed size.

22 DH D 1,10, 2 H 2, 0-1, -1 Chicken game, or Dove & Hawk The population plays: 1-p strategy D, and p strategy H. The fitness of a player (the no. of his offsprings): In a short time interval τ : the total number of D,H players after replication: H players:

23 The new proportion of H players:

24 We have not used the particular numbers of the Chicken game. The above equation holds for all 2x2 games, And it is independent of U. The Replicator Dynamics Now apply it to Chicken: DH D 1,10, 2 H 2, 0-1, -1

25 DH D 1,10, 2 H 2, 0-1, -1 t 1/2 D H p < 1/2 p

26 CD C 2,20, 3 D 3, 01, 1 t C D The Prisoners’ Dilemma p

27 LR L 1,10, 0 R 2, 2 t L R p < 1/3 Coordination Game p 1/3 p > 1/3 Spontaneous Order, (no one maximizes)