Rational Agents for the Card Game “BS” Jeff Reilly, Brian Munce, Stephen Tanguis, Alex Keeler.

Slides:



Advertisements
Similar presentations
Steps to Making a Decision Step 5: Evaluate results of the decision and accept responsibility for results of the decision. Step 4: Make a decision,
Advertisements

SOCiable A Game of Life Chances ©Jon Witt Version 1.0.
ON THE BOREL AND VON NEUMANN POKER MODELS. Comparison with Real Poker  Real Poker:  Around 2.6 million possible hands for 5 card stud  Hands somewhat.
Markov Decision Process
Apostles Chess Club Lesson #4. Algebraic Chess Notation System The board is set up from white’s position. Black must look at the board from the white.
Introduction to Philosophy Lecture 6 Pascal’s wager
Making Decisions and Predictions
Lecture 10. Simplified roulette European roulette has numbers 0,1,…36. xD0s
Section 1.1, Slide 1 Copyright © 2014, 2010, 2007 Pearson Education, Inc. Section 13.4, Slide 1 13 Probability What Are the Chances?
When Intuition Differs from Relative Frequency
Warm up 1)We are drawing a single card from a standard deck of 52 find the probability of P(seven/nonface card) 2)Assume that we roll two dice and a total.
Rules for Classroom Play. Setup 1. Remove blue ACTION cards from the Observatory deck 2. Shuffle both decks well and set Volcano deck to one side 3. Deal.
Card Counting What is it, how does it work, and can I use it to pay for college? (and if it does work, do I even have to go to college?) Jeff O’Connell.
Created by Charles Jenkins
Mathematics and the Game of Poker
1 Probability Parts of life are uncertain. Using notions of probability provide a way to deal with the uncertainty.
Lectures in Microeconomics-Charles W. Upton Minimax Strategies.
Using Probabilistic Knowledge And Simulation To Play Poker (Darse Billings …) Presented by Brett Borghetti 7 Jan 2007.
Introduction to Cognition and Gaming 9/22/02: Bluffing.
Minimax Strategies. Everyone who has studied a game like poker knows the importance of mixing strategies. –With a bad hand, you often fold –But you must.
FRIENDS “The One About the Rugby Game” Premise A (main idea): Chandler’s preemptive strike against his ex-girlfriend.
Games of Incomplete Information. These games drop the assumption that players know each other’s preferences. Complete info: players know each other’s preferences.
VOCABULARY  Deck or pack  Suit  Hearts  Clubs  Diamonds  Spades  Dealer  Shuffle  Pick up  Rank  Draw  Set  Joker  Jack 
Introduction to the Big Stack Strategy (BSS) Strategy: No Limit.
John Neal and Kalli Smith. Each player has a master number that starts at 10. The goal of the game is to get your opponent’s master number to 0. The first.
Section 1.1, Slide 1 Copyright © 2014, 2010, 2007 Pearson Education, Inc. Section 13.4, Slide 1 13 Probability What Are the Chances?
Part 3 – REFUTING OPPOSING ARGUMENTS.  Before you start writing an argumentative essay, I strongly suggest you to prepare an outline and first, write.
PING PONG (Table Tennis)
Texas Holdem Poker With Q-Learning. First Round (pre-flop) PlayerOpponent.
Chapter 3 Section 3.5 Expected Value. When the result of an experiment is one of several numbers, (sometimes called a random variable) we can calculate.
Brian Duddy.  Two players, X and Y, are playing a card game- goal is to find optimal strategy for X  X has red ace (A), black ace (A), and red two (2)
PowerPoint created by: AJ Thomas Date created: 1/29/14
A Game-Theoretic Approach to Strategic Behavior. Chapter Outline ©2015 McGraw-Hill Education. All Rights Reserved. 2 The Prisoner’s Dilemma: An Introduction.
Paigow Training Hai J Shen International Association of Certified Surveillance Professionals.
1.5 Conditional Probability 1. Conditional Probability 2. The multiplication rule 3. Partition Theorem 4. Bayes’ Rule.
Investigation #1 Factors and Products.
Starcraft Opponent Modeling CSE 391: Intro to AI Luciano Cheng.
Catch the Spirit of Mathematical Practices Mathematics Investigations Q-Cards: Rational Numbers The Q-Card game has 8 starter cards, 28 playing cards,
Section 3.1: Proof Strategy Now that we have a fair amount of experience with proofs, we will start to prove more difficult theorems. Our experience so.
Learning to Play KardKuro Goals: Have Fun while Practicing Addition and Subtraction. Improve Social Learning Opportunities with Classmates. Become familiar.
Introduction to Philosophy Lecture 6 Pascal’s wager By David Kelsey.
Pitch Playing Agent Project for Into to AI Jody Ammeter.
Games. Adversaries Consider the process of reasoning when an adversary is trying to defeat our efforts In game playing situations one searches down the.
Senior Project Poster Day 2007, CIS Dept. University of Pennsylvania Reversi Meng Tran Faculty Advisor: Dr. Barry Silverman Strategies: l Corners t Corners.
Hypothesis Testing. The 2 nd type of formal statistical inference Our goal is to assess the evidence provided by data from a sample about some claim concerning.
Poker as a Testbed for Machine Intelligence Research By Darse Billings, Dennis Papp, Jonathan Schaeffer, Duane Szafron Presented By:- Debraj Manna Gada.
Neural Network Implementation of Poker AI
Part 3 Linear Programming
An Introduction to Game Theory Math 480: Mathematics Seminar Dr. Sylvester.
Math-Nuts Janie, Johnny, Jesse, Bob Introduction to Algebra and Geometry Fall 2011.
GamblingGambling What are the odds? Jessica Judd.
Game Procedures Who does what, where, when, and how?
Zero-sum Games The Essentials of a Game Extensive Game Matrix Game Dominant Strategies Prudent Strategies Solving the Zero-sum Game The Minimax Theorem.
Will Britt and Bryan Silinski
Picking Apples. Subtraction game. Turn over two cards from 0-10 Work out the difference. If you have an apple with this amount put a counter on it. First.
Christoph F. Eick: Thoughts on the Rook Project Challenges of Playing Bridge Well 
Team Sport: Football. 1. Fouling an opponent: Stopping an opponent illegally. Making contact with the opponent without touching the ball or being aggressive.
By: Donté Howell Game Theory in Sports. What is Game Theory? It is a tool used to analyze strategic behavior and trying to maximize his/her payoff of.
 Honor the challenge in this work and set the tone for teachers as learners  Build conceptual knowledge of fractions, and acknowledge most of us come.
For traditional happy families, all the cards are dealt our evenly. Happy Families is a card game traditionally, played in the UK, with special packs of.
Uncertainty and Games (Ch. 15). Uncertainty If a game outcome is certain can it achieve meaningful play? –Example of such a game? Two kinds of uncertainty:
Section 5.5 Application: The Card Game of War. 5.5 Application: The Card Game of War A deck of cards is shuffled and dealt to two players The players.
Name 8/29/17.
Lecture 11.
Lecture 10.
Probability of casino games
J. J. Divin Astrid Glende Jon McClain Lorenzo Moore
Cheating in Pokemon How to Save Our Game
Multiplication and Division Facts Rummy
2019 SAIMC Puzzle Challenge General Regulations
Presentation transcript:

Rational Agents for the Card Game “BS” Jeff Reilly, Brian Munce, Stephen Tanguis, Alex Keeler

The Game Known by: “BS”, “Cheat”, and various other names Rules: A deck is evenly dealt between the players of the game. Play begins with a certain card rank and player. That player may discard a number of cards from his hand to the table, claiming the rank and number of cards that he discards. The other players are then, in turn, given the chance to call the current players bluff. If the call is correct, the current player must take all the discarded cards and add them to his or her hand; if incorrect, the player who ‘called’ instead receives all of the cards in the discard pile. A player wins the game when they have no more cards in their hand.

Approach to Solving the Problem Due to the nature of the game of BS, there is much uncertainty at any stage in the game. This makes the state space huge, so state-space searching is not a great idea. Need to use probability to help make rational decisions

Multilevel Reasoning in BS Reasoning about one’s own hand Reasoning about opponents’ hands and the discard pile Reasoning about what opponents think about your hand

About the Bots HonestBot: Simply a bot that never claims to play cards it doesn’t have, and only calls if it is 100% sure someone is lying. LearningBot: A bot that attempts to model the aggressiveness of its opponents’ cheating based on previous knowledge, and adjusts its calls accordingly. DudeBot: Bot that calls more readily against players claiming to play cards that have already been played. RandomBot: Plays the game while choosing to cheat or call partly randomly to “confuse” other bots. NoRandomBot: Doesn’t have any random factors, only calls or cheats if it believes it has >50% probability of success.

Factors Number and rank of cards in one’s own hand Cards thought or known to be in other players hands or discard pile Individual players’ histories of cheating and calling Total number of cards in hand and total number of cards in the discard pile Aggressiveness arguments for cheating and calling

The Results Running sets of 1000 or 5000 games at a time, we received quite consistent results for our bots. In general for games where there is a reasonable amount of calls made, LearningBot wins because it has a large enough dataset to successfully model its opponents. When allowed to model its opponents over the course of numerous games, its win rate increases, but falls off as the number of games played increases. However, in games where there are many, many failed calls made, LearningBot starts to lose often. We found that cheating is often more of a positive factor for success of a bot than calling is, unless there are one or more players in game calling aggressively/often. Since failing at either has the same consequences, it is much more beneficial to risk cheating than calling in most cases. (Specific result data to be tabulated and appended)