1 Phase II - Checkers Operator: Eric Bengfort Temporal Status: End of Week Five Location: Phase Two Presentation Systems Check: Checkers Checksum Passed.

Slides:



Advertisements
Similar presentations
1 Machine Learning: Lecture 1 Overview of Machine Learning (Based on Chapter 1 of Mitchell T.., Machine Learning, 1997)
Advertisements

ChooseMove=16  19 V =30 points. LegalMoves= 16  19, or SimulateMove = 11  15, or …. 16  19,
Martin Boyd Christopher Hirunthanakorn
Adversarial Search We have experience in search where we assume that we are the only intelligent being and we have explicit control over the “world”. Lets.
Computers playing games. One-player games Puzzle: Place 8 queens on a chess board so that no two queens attack each other (i.e. on the same row, same.
Randomized Strategies and Temporal Difference Learning in Poker Michael Oder April 4, 2002 Advisor: Dr. David Mutchler.
Tic Tac Toe Prototype Following is a prototype of a Tic Tac Toe program. The main goal of the program is to provide quick and simple entertainment. It.
Playing Tic Tac Toe with Neural Networks Justin Herbrand CS/ECE/ME 539.
Tic Tac Toe Game Design Using OOP
CS 4700: Foundations of Artificial Intelligence Bart Selman Reinforcement Learning R&N – Chapter 21 Note: in the next two parts of RL, some of the figure/section.
Tic Tac Toe Architecture CSE 5290 – Artificial Intelligence 06/13/2011 Christopher Hepler.
Integer Tic Tac Toe Let’s Begin Rules: 1.Erase all x’s and o’s from the previous game before you begin. 2.Decide which player will be x’s and which will.
2002/11/15Game Programming Workshop1 A Neural Network for Evaluating King Danger in Shogi Reijer Grimbergen Department of Information Science Saga University.
Class Project Due at end of finals week Essentially anything you want, so long as it’s AI related and I approve Any programming language you want In pairs.
Chess AI’s, How do they work? Math Club 10/03/2011.
Administrative This was the last homework for the semester (yay!) First run of games: October 16 nd in class –Short document describing: goal + operational.
Minimax and Alpha-Beta Reduction Borrows from Spring 2006 CS 440 Lecture Slides.
Artificial Intelligence in Game Design
CS AI Practicum Fall Robot Downey Jr Will Kiffer Joey Staehle Andrew Bunyea.
Class Project Due at end of finals week Essentially anything you want, so long as its AI related and I approve Any programming language you want In pairs.
CS510 AI and Games Final Report on Dec Juncao Li.
RULES Each player begins the game with twelve normal pieces (either white or black). The pieces are automatically set in their proper positions. The object.
Monte Carlo Go Has a Way to Go Haruhiro Yoshimoto (*1) Kazuki Yoshizoe (*1) Tomoyuki Kaneko (*1) Akihiro Kishimoto (*2) Kenjiro Taura (*1) (*1)University.
1 Reinforcement Learning: Learning algorithms Function Approximation Yishay Mansour Tel-Aviv University.
Introduction (Chapter 1) CPSC 386 Artificial Intelligence Ellen Walker Hiram College.
1 Learning Agents Laboratory Computer Science Department George Mason University Prof. Gheorghe Tecuci 3. Rote Learning.
Development of a Machine-Learning-Based AI For Go By Justin Park.
 Summary  How to Play Go  Project Details  Demo  Results  Conclusions.
Learning BlackJack with ANN (Aritificial Neural Network) Ip Kei Sam ID:
Application of Artificial Intelligence to Chess Playing Jason Cook Capstone Project.
Computer Go : A Go player Rohit Gurjar CS365 Project Presentation, IIT Kanpur Guided By – Prof. Amitabha Mukerjee.
Machine Learning for an Artificial Intelligence Playing Tic-Tac-Toe Computer Systems Lab 2005 By Rachel Miller.
CSC Intro. to Computing Lecture 22: Artificial Intelligence.
1 CS 4701 – Project Proposal Jane Park (jp624) Ran Zhao (rz54)
1 Phase IV – Bayesian Learning Reloaded Operator: Eric Bengfort Temporal Status: End of Week Eight Location: Phase Four Presentation Systems Check: Cleared.
CHECKERS: TD(Λ) LEARNING APPLIED FOR DETERMINISTIC GAME Presented By: Presented To: Amna Khan Mis Saleha Raza.
ADAPTATION Activities can be adapted in many ways. The intention in making any of the changes to activities is that your skill development can benefit.
By: Kyle Tierney And Alec Tzanabos
Carla P. Gomes CS4700 CS 4701: Practicum in Artificial Intelligence Carla P. Gomes
Kansas State University Department of Computing and Information Sciences CIS 730: Introduction to Artificial Intelligence Lecture 9 of 42 Wednesday, 14.
DEEP RED An Intelligent Approach to Chinese Checkers.
SAL: A Game Learning Machine Joel Paulson & Brian Lanners.
Lesson 1 History of Chess Why We Teach Chess Goal of Chess.
Each piece is represented by a symbol. The pieces all stand in the same position at the start of the game the pieces are the Rook, the Knight, the Bishop,
Playing Tic-Tac-Toe with Neural Networks
Why War Games is the one and only full length major motion picture that you will watch this year and why it is academically relevant. Please don’t fire.
Backgammon Group 1: - Remco Bras - Tim Beyer - Maurice Hermans - Esther Verhoef - Thomas Acker.
TRY NOW: What do you remember? A number that you can divide by 2. A number that only has two factors. A probability calculated using math. A probability.
Senet is a ancient Egyptian board game.
The Pentium Goes to Vegas Training a Neural Network to Play BlackJack Paul Ruvolo and Christine Spritke.
More on Logic Today we look at the for loop and then put all of this together to look at some more complex forms of logic that a program will need The.
Deep Learning and Deep Reinforcement Learning. Topics 1.Deep learning with convolutional neural networks 2.Learning to play Atari video games with Deep.
AI: AlphaGo European champion : Fan Hui A feat previously thought to be at least a decade away!!!
WHAT IN THE WORLD IS IT?! Computer Processing Computer Basics by Bill Cowan Page 9.
Artificial Intelligence in Game Design Board Games and the MinMax Algorithm.
Chess as training tool for medical students Dr Raj Chess coordinator Ripple Institute.
Understanding AI of 2 Player Games. Motivation Not much experience in AI (first AI project) and no specific interests/passion that I wanted to explore.
Understanding AlphaGo. Go Overview Originated in ancient China 2,500 years ago Two players game Goal - surround more territory than the opponent 19X19.
Adversarial Environments/ Game Playing
Next Level Tic-Tac-Toe
Spring 2003 Dr. Susan Bridges
CS 4700: Foundations of Artificial Intelligence
Training Neural networks to play checkers
Training a Neural Network
Dr. Unnikrishnan P.C. Professor, EEE
Deep Neural Networks: A Hands on Challenge Deep Neural Networks: A Hands on Challenge Deep Neural Networks: A Hands on Challenge Deep Neural Networks:
CSE (c) S. Tanimoto, 2007 Search 2: AlphaBeta Pruning
Dividing Integers.
Tic-Tac-Toe Game Engine
Unit II Game Playing.
Presentation transcript:

1 Phase II - Checkers Operator: Eric Bengfort Temporal Status: End of Week Five Location: Phase Two Presentation Systems Check: Checkers Checksum Passed Status: Systems Functional

2 Previously on Eric’s PowerPoint… Neural Network – Learns an Arbitrary Function. And now the conclusion: Today’s Episode… Checkers!

3 The Goal Use my Neural Network to teach a computer how to play checkers intelligently against a human. The Why Something tangible / Hands on User can care about the algorithm, or not Somewhere between Tic Tac Toe and Chess I don’t like Chess

4 The How y = (x1 + x2) / 100 That was then… and this is now ??? *No clearly defined inputs. *What kind of function anyway!?

5 The Master Plan On computer’s turn: Generate Possible Moves (just through the rules of the game) Resolve each Possible Move, giving us a resulting board Somehow determine how favorable each resulting board is Have computer make the move which resulted in the most favorable board, thus making the best possible move. Neural Network to the Rescue! Create a Neural Network which takes a “board” (as input) and returns a value (as output) of how favorable said board is to the computer player.

6 AI Brain Mach One My Proposed Inputs Number of Black Pieces Number of Black Kings Number of Jumps Black can make Number of Black Edge Hogs Number of Black Pieces in the Fray Number of White Pieces Number of White Kings Number of Jumps White can make Number of White Edge Hogs Number of White Pieces in the Fray Training Data Sample

7 But where does Training Data come from!? *Probability Theory *Adaptation of tried method

8 Randomized Self Play My Revision Half a million games per board! 7 to 10 minutes to make just one Training Data Instance! Hijacked Computers Used my Phase I to generate a Neural Network and saved it!

9 Let’s Fire up the Demo Development Features! Features! Features! Findings Decisions Results