Lecture 12.

Slides:



Advertisements
Similar presentations
By: Jonathan Quenzer. To have a computer learn how to play Blackjack through reinforcement learning Computer starts off with no memory. After each hand.
Advertisements

Lecture 11. R function Function is a wrapper that allows us to write code in modules Back to Handout Homework: Create a function for drunken sailor –
Lecture 13. Poker Two basic concepts: Poker is a game of skill, not luck. If you want to win at poker, – make sure you are very skilled at the game, and.
Name: Trương Hoài Anh Facebook: Quasar Hoaianh
APPENDIX An Alternative View of the Payoff Matrix n Assume total maximum profits of all oligopolists is constant at 200 units. n Alternative policies.
MIT and James Orlin © Game Theory 2-person 0-sum (or constant sum) game theory 2-person game theory (e.g., prisoner’s dilemma)
Copyright (c) 2003 Brooks/Cole, a division of Thomson Learning, Inc
Game Theory, Part 1 Game theory applies to more than just games. Corporations use it to influence business decisions, and militaries use it to guide their.
Part 3: The Minimax Theorem
Lecture 10. Simplified roulette European roulette has numbers 0,1,…36. xD0s
Card Counting What is it, how does it work, and can I use it to pay for college? (and if it does work, do I even have to go to college?) Jeff O’Connell.
GAME THEORY.
An application of the Probability Theory
Lecture 1 - Introduction 1.  Introduction to Game Theory  Basic Game Theory Examples  Strategic Games  More Game Theory Examples  Equilibrium  Mixed.
Lectures in Microeconomics-Charles W. Upton Minimax Strategies.
Game Theory Objectives:
Some Definitions –Maxi-min (mini-max) strategy: The maxi-min strategy is the path with the highest possible (maximum) worst (minimum) outcome. –Dominant.
Minimax Strategies. Everyone who has studied a game like poker knows the importance of mixing strategies. –With a bad hand, you often fold –But you must.
Warm-up The mean grade on a standardized test is 88 with a standard deviation of 3.4. If the test scores are normally distributed, what is the probability.
Blackjack: Myths vs. Reality Group K Andrew KerrAndrew Phillips Sven SkoogWoj Wrona.
Honors Precalculus: Do Now 1.) You are betting with your friend. Every time you flip heads, your friend pays you a dollar. Every time you flip tails, you.
Blackjack: An Analysis of Probability By: John Theobald.
Brian Duddy.  Two players, X and Y, are playing a card game- goal is to find optimal strategy for X  X has red ace (A), black ace (A), and red two (2)
Game Theory, Part 2 Consider again the game that Sol and Tina were playing, but with a different payoff matrix: H T Tina H T Sol.
Part 3 Linear Programming
Decision Analysis Mary Whiteside. Decision Analysis Definitions Actions – alternative choices for a course of action Actions – alternative choices for.
1 What is Game Theory About? r Analysis of situations where conflict of interests is present r Goal is to prescribe how conflicts can be resolved 2 2 r.
Lecture 12. Game theory So far we discussed: roulette and blackjack Roulette: – Outcomes completely independent and random – Very little strategy (even.
WOULD YOU PLAY THIS GAME? Roll a dice, and win $1000 dollars if you roll a 6.
GamblingGambling What are the odds? Jessica Judd.
1 Optimizing Decisions over the Long-term in the Presence of Uncertain Response Edward Kambour.
GAME THEORY Day 5. Minimax and Maximin Step 1. Write down the minimum entry in each row. Which one is the largest? Maximin Step 2. Write down the maximum.
9.2 Mixed Strategy Games In this section, we look at non-strictly determined games. For these type of games the payoff matrix has no saddle points.
Math Puzzles and Game Theory Final Exam Work through the slides, follow the directions, and fill in all required information.
Gambling and probability 1. Odds and football.  Predict the Premier League results for this weekend.  Can you estimate the probability of a win/draw/loss.
16.6 Expected Value.
Money and Banking Lecture 10. Review of the Previous Lecture Application of Present Value Concept Compound Annual Rate Interest Rates vs Discount Rate.
Shane Murphy ECON 102 Tutorial: Week 8 Shane Murphy
Correlated equilibria, good and bad: an experimental study
Decisions under uncertainty and risk
You Bet Your Life - So to Speak
Lecture 13.
Game Theory Just last week:
Starter   In a certain game show, a contestant is presented with three doors. Behind one of the doors is an expensive prize; behind the others are goats.
Input – Output Models P = # of items produced
Lecture 14.
Lecture 11.
Lecture 10.
Extensive-form games and how to solve them
Probability of casino games
The Costs and Benefits of Gambling
Game Theory.
Probability: Living with the Odds
PROBABILITY RULES. PROBABILITY RULES CHANCE IS ALL AROUND YOU…. YOU AND YOUR FRIEND PLAY ROCK-PAPER-SCISSORS TO DETERMINE WHO GETS THE LAST SLICE.
Alpha-Beta Search.
Truth tables: Ways to organize results of Boolean expressions.
Truth tables: Ways to organize results of Boolean expressions.
Alpha-Beta Search.
Game Theory II Solutions 1
Blackjack: Counting Hands and Counting Cards
Alpha-Beta Search.
Counting Methods and Probability Theory
Investigation 2 Experimental and Theoretical Probability
Alpha-Beta Search.
What does it really mean?
Alpha-Beta Search.
BY: Cesar, Jennifer, Adrianne & Allen
Counting Methods and Probability Theory
Warm Up What is the type of sampling for 1-3? 1. “The names of 50 contestants are written on 50 cards. The cards are placed in a hat and 10 names are drawn.”
Presentation transcript:

Lecture 12

Project 2 Select and analyze a game of chance DUE: on November 10. Use calculation, R or other mean to make QUANTITATIVE observations about the game Write a 5 page paper. Include: Description of the game Your analysis Conclusions References DUE: on November 10. Come to my office to discuss what makes a suitable project!

Black jack analysis We will use R to compute the probability of dealer going bust. We use hard 17 stop rule for the dealer. R code available on the website R function (from handout)

R function Function is a wrapper that allows us to write code in modules Back to Handout

Estimated Results 17 18 19 20 21 BJ bust 0.146 0.138 0.135 0.176 0.074 0.048 0.283

Counting cards Basic counting rule: +1 for 2-6 0 for 7-9 -1 for 10-A We will again use R to compute the probability of dealer going bust. We only start playing when the count becomes 17 R code available in resource section of sakai

Estimated Results – Count +17 18 19 20 21 BJ bust Only +17 0.138 0.132 0.128 0.198 .064 .062 0.278 plain 0.146 0.135 0.176 0.074 0.048 0.283 Quote from wikipedia: “Another aspect of the probability of card counting is that, at higher counts, the player's probability of winning a hand is only slightly changed and still below 50%. The player's edge over the house on such hands does not come from the player's probability of winning the hands. Instead it comes from the increased probability of blackjacks, increased gain and benefit from doubling, splitting and surrender, and the insurance side bet, which becomes profitable at high counts.”

Homework Modify the R code to use soft 17. Always stop if 18 or higher Stop on 17 unless there is A counted as 11 (in which case dealer hit himself/herself) What do you expect to happen? Suggestion: Code the basic strategy http://www.wikihow.com/Sample/Blackjack-Chart

Game theory So far we discussed: roulette and blackjack Roulette: Outcomes completely independent and random Very little strategy (even that is curbed by minimums and maximum bet rules) Blackjack Dealers outcome completely random (no strategy) There is some dependence between draws Strategy can be useful (counting cards and adjusting play accordingly)

Game theory Poker What is a rational (best?) strategy? MAXIMIN All the participant are following a strategy that uses the information based on the cards and behaviour other players What is a rational (best?) strategy? MAXIMIN Select a strategy S If the opponent new my strategy, what is the worst they can do to me? Select the strategy that maximizes this worst case scenario

Understanding role of strategy Coin matching game: You and your friend each have a coin. You each secretly choose to show “heads” or “tails”. You simultaneously show your choice. The payoff: If the coins are both “heads”, your friend pays you $1. If the coins are both “tails”, your friend pays you $9. If the coins do not match, you pay your friend $5. Is this a fair game?

Coin matching game you\friend H T 1 -5 9 If both of us flip a coin: Expected gain = 1*0.5*0.5+(-5)*0.5*0.5+(-5)*0.5*0.5+9*0.5*0.5=0 (Looks fair but is it?) Play matlab game We do not need to flip a fair coin – we can choose any proportion of H/T we want! Consider our proportion of H p and friends proportion of H q. For now assume independence between us and friend Expected gain = 1*p*q+(-5)*p*(1-q)+(-5)*(1-p)*q+9*(1-p)*(1-q)=9-14p-14q+20pq How to select p?

Maximin Main idea: We want select p to maximize expected win if positive we might also want to minimize variance What is best depends on the friends strategy: (Depends on friends choices unknown to me) If I select p – if my friends selects all T gain =9-14p all H gain=-5+6p

Maximin Notice that smaller of the two lines is less than -0.8 The best option is p=0.7 – gain =-0.8 

Minimax (maximin for friend) Friends choices What is best for the friend depends on my strategy (unknown to him) My friends select q – if I selects all H gain =9-14q all T gain=-5+6q Notice that larger (my gain his loss!) of the two less than -0.8 The best option is q=0.7 – expected gain =-0.8 (friend gains 0.8 on average) Nash equilibrium if the other player is playing optimally there is nothing to gain from changing strategies