Paul De Palma George Luger Departments of Computer Science Gonzaga University University of New Mexico 1.

Slides:



Advertisements
Similar presentations
Genetic Algorithms By: Anna Scheuler and Aaron Smittle.
Advertisements

Genetic Algorithms. Some Examples of Biologically Inspired AI Neural networks Evolutionary computation (e.g., genetic algorithms) Immune-system-inspired.
Non-Linear Problems General approach. Non-linear Optimization Many objective functions, tend to be non-linear. Design problems for which the objective.
Genetic Algorithms1 COMP305. Part II. Genetic Algorithms.
1 IOE/MFG 543 Chapter 14: General purpose procedures for scheduling in practice Section 14.5: Local search – Genetic Algorithms.
COMP305. Part II. Genetic Algorithms. Genetic Algorithms.
Genetic algorithms for neural networks An introduction.
Introduction to Genetic Algorithms Yonatan Shichel.
Genetic Algorithms Learning Machines for knowledge discovery.
COMP305. Part II. Genetic Algorithms. Genetic Algorithms.
Chapter 14 Genetic Algorithms.
Selecting Informative Genes with Parallel Genetic Algorithms Deodatta Bhoite Prashant Jain.
Genetic Algorithm What is a genetic algorithm? “Genetic Algorithms are defined as global optimization procedures that use an analogy of genetic evolution.
Chapter 6: Transform and Conquer Genetic Algorithms The Design and Analysis of Algorithms.
The Performance of Evolutionary Artificial Neural Networks in Ambiguous and Unambiguous Learning Situations Melissa K. Carroll October, 2004.
Optimization of thermal processes2007/2008 Optimization of thermal processes Maciej Marek Czestochowa University of Technology Institute of Thermal Machinery.
Genetic Algorithms and Ant Colony Optimisation
Evolving a Sigma-Pi Network as a Network Simulator by Justin Basilico.
Ecology Ecological valance M. Saadatian.
SOFT COMPUTING (Optimization Techniques using GA) Dr. N.Uma Maheswari Professor/CSE PSNA CET.
1 Speech Perception 3/30/00. 2 Speech Perception How do we perceive speech? –Multifaceted process –Not fully understood –Models & theories attempt to.
Evolution Strategies Evolutionary Programming Genetic Programming Michael J. Watts
1. Natural selection can only occur if there is variation among members of the same species. WHY? Variation in a population results from mutation and.
© Negnevitsky, Pearson Education, Lecture 10 Evolutionary Computation: Evolution strategies and genetic programming Evolution strategies Evolution.
CS 484 – Artificial Intelligence1 Announcements Lab 3 due Tuesday, November 6 Homework 6 due Tuesday, November 6 Lab 4 due Thursday, November 8 Current.
Lecture 8: 24/5/1435 Genetic Algorithms Lecturer/ Kawther Abas 363CS – Artificial Intelligence.
Boltzmann Machine (BM) (§6.4) Hopfield model + hidden nodes + simulated annealing BM Architecture –a set of visible nodes: nodes can be accessed from outside.
Presenter: Chih-Yuan Chou GA-BASED ALGORITHMS FOR FINDING EQUILIBRIUM 1.
More on Heuristics Genetic Algorithms (GA) Terminology Chromosome –candidate solution - {x 1, x 2,...., x n } Gene –variable - x j Allele –numerical.
An Introduction to Genetic Algorithms Lecture 2 November, 2010 Ivan Garibay
1 Machine Learning: Lecture 12 Genetic Algorithms (Based on Chapter 9 of Mitchell, T., Machine Learning, 1997)
GENETIC ALGORITHM A biologically inspired model of intelligence and the principles of biological evolution are applied to find solutions to difficult problems.
Machine Learning 1 Machine Learning 1 Genetic Algorithms.
Genetic Algorithms. Evolutionary Methods Methods inspired by the process of biological evolution. Main ideas: Population of solutions Assign a score or.
Mechanisms of Population Evolution
1 Genetic Algorithms and Ant Colony Optimisation.
Remainder of Chapter 23 Read the remaining materials; they address information specific to understanding evolution (e.g., variation and nature of changes)
09/20/04 Introducing Proteins into Genetic Algorithms – CSIMTA'04 Introducing “Proteins” into Genetic Algorithms Virginie LEFORT, Carole KNIBBE, Guillaume.
Genetic Algorithms CSCI-2300 Introduction to Algorithms
Genetic Algorithms What is a GA Terms and definitions Basic algorithm.
Genetic Algorithms. 2 Overview Introduction To Genetic Algorithms (GAs) GA Operators and Parameters Genetic Algorithms To Solve The Traveling Salesman.
EE749 I ntroduction to Artificial I ntelligence Genetic Algorithms The Simple GA.
Machine Learning A Quick look Sources: Artificial Intelligence – Russell & Norvig Artifical Intelligence - Luger By: Héctor Muñoz-Avila.
Chapter 16: The Evolution of Populations and Speciation Objectives: Describe two causes of genotypic variation in a population Explain how to compute allele.
School of Computer Science & Information Technology G6DICP - Lecture 4 Variables, data types & decision making.
1 Danny Hillis and Co-evolution Between Hosts and Parasites I 590 4/11/2005 Pu-Wen(Bruce) Chang.
GENETIC ALGORITHM Basic Algorithm begin set time t = 0;
An evolutionary approach for improving the quality of automatic summaries Constantin Orasan Research Group in Computational Linguistics School of Humanities,
1 Autonomic Computer Systems Evolutionary Computation Pascal Paysan.
1 Contents 1. Basic Concepts 2. Algorithm 3. Practical considerations Genetic Algorithm (GA)
An Introduction to Genetic Algorithms Lecture 2 November, 2010 Ivan Garibay
Genetic Algorithm Dr. Md. Al-amin Bhuiyan Professor, Dept. of CSE Jahangirnagar University.
Genetic Programming Using Simulated Natural Selection to Automatically Write Programs.
Artificial Intelligence By Mr. Ejaz CIIT Sahiwal Evolutionary Computation.
IP5: Hardy-Weinberg/Genetic Drift/Gene Flow EK1A1: Natural Selection is a major mechanisms of natural selection EK1A3: Evolutionary change is also driven.
Genetic Algorithm(GA)
Genetic Algorithm. Outline Motivation Genetic algorithms An illustrative example Hypothesis space search.
Genetic (Evolutionary) Algorithms CEE 6410 David Rosenberg “Natural Selection or the Survival of the Fittest.” -- Charles Darwin.
Introduction to Genetic Algorithms
Chapter 14 Genetic Algorithms.
Genetic Algorithm in TDR System
MAE 552 Heuristic Optimization
Evolution Strategies Evolutionary Programming
Bulgarian Academy of Sciences
An evolutionary approach to solving complex problems
TO DO How Scientists Know About Punctuated Equilibrium.
Genetic Algorithms Artificial Life
Genetic Algorithms CSCI-2300 Introduction to Algorithms
Boltzmann Machine (BM) (§6.4)
Artificial Intelligence CIS 342
Presentation transcript:

Paul De Palma George Luger Departments of Computer Science Gonzaga University University of New Mexico 1

 Reversal of the expected linear ordering of sounds  Instead of xy we find yx  Examples  tl shift: borrowed noun chipotle  chipolte (SAE: a spice)  ts shift: binyan 5 hitsader  histader (Modern Hebrew: “he got organized” )  hr shift: dative singular tehernek  dative plural terhek (Hungarian: “load”)  rh shift: Expected tiirhisaskhus  actual tihriasku (Pawnee: “he is called”)  Metathesis Myth: sporadic, irregular, due to performance errors  String of sounds realized as xy in language A can be yx in language B 2

 A usage-based phonological account (Elizabeth Hume)  primarily synchronic  Can be extended to language change  Utterance Selection Theory (William Croft)  Genetic Algorithm operationalizes Utterance Selection Theory 3

 Metathesis requires two conditions 1. An indeterminate speech signal 2. Output that conforms to existing patterns in language  Example: chipotle/chipolte  In SAE, tl (stop consonant preceding a lateral) is indeterminate  Stop consonant following the lateral is frequent in post-vocalic position (cold,sold,mold,fold,molt,bolt,jolt,colt)  SAE speakers transform tl to lt 4

 Natural Selection requires:  A population of individuals with distinct characteristics  A mechanism for replicating those characteristics  Interaction among individuals and the environment  Selective pressure from the environment producing differential reproduction of the individuals and characteristics  Extended to language:  Language: A population of utterances (not a system of signs or a collection of words and rules that operate on them)  Normal replication: utterance conforms to the conventions of language use  Altered replication: utterance violates convention  Selection: graduate establishment of a new convention through use 5

 Operationalizes (i.e, renders computationally precise)  Usage-based account of metathesis  Usage-based account of language change  Based loosely on the Darwinian notion of natural selection 6

GA() { Initialize(population); //build initial population ComputeCost(population); //apply cost function Sort(population); //rank population while (population has not converged on a good-enough solution) { Pair(population); //decide which members reproduce Mate(population); //exchange characteristics Mutate(population); //randomly perturb genes Sort(population); //rank population TestConvergence(population); //has a new species appeared? } 7

Embodies most of the theory being modeled. For example, 1. Prevocalic stop (e.g., te) is more salient than a postvocalic stop. Give a fitness boost. 2. Penalize words with postvocalic stops (e.g., et) 3. Glottals (e.g., g), liquids (e.g., l), glides (e.g., w) bleed into adjacent sounds when followed by a stop (e.g., t). Penalize sequences like lt. 4. A stop followed by any non-stop consonant (e.g., tl) is perceptually weak. Penalize stop/non-stop consonant sequences 5. A stop followed by a strident (e.g., ts) is perceptually weak. Penalize prestrident stops. 8

 Each utterance in the population is tagged with a collection of boosts and penalties  The collection makes the underlying phonological theory computationally precise 9

 Encode the GA as a collection of objects in Java executable under Linux  Parameters  Population size: 64 strings  Mutation factor:.5%  For each of 1, 2, 4 base strings in the population, begin at parity then double the number of target strings three times  Fill out the balance of the population with randomly generated character sequences  For each population configuration  Run GA 250 times  250 generations per run  Collect results per run 10

1. Input an initial population of the base word and the target word 2. Generate random sequences of characters that fill out the population. 3. Assign a fitness value to each of the sequences that comprise the population. 4. Sort the population by fitness value 5. Collect the population into two-tuples from highest to lowest fitness 6. Exchange pieces of sounds between each pair 7. Randomly shift a fixed fraction of the sounds  the action of chemical/biological/radiological mutagens on individuals. 8. Sort the population. Stop if some predetermined condition is met, else go to step 3. 11

 chipotle/chipolte  After 60 generations chipolte tokens are 95% of the population  chipotle disappears within 3 generations  hitsader/histader  After 48 generations histader tokens are 97.3% of the population  hitsader disappears within 2 generations 12

 Accurate but underspecified  Computational model supplies missing precision  Usage-based aspect modeled as a frequency affect  Target tokens tends stabilize more quickly at a higher fraction as their number in the initial population increases  The larger the number of base tokens in the initial population, the better the performance 13

 Hume’s account of metathesis can be reframed as an account of (one type) of language change  Can be rendered computationally precise using the Genetic Algorithm 14

15

Ratio of Base to Target Generation Chipotle Disappeared Generation Chipolte Stabilized Percent of Chipolte Tokens at Stabilization 1: : : : : : : : : : : :

Ratio of Base to Target Generation Hitsader Disappeared Generation Histader Stabilized Percent of Histader Tokens at Stabilization 1: : : : : : : : : : : :

 Use transcribed corpora to determine the frequency of both vulnerable cues and the targets of metathetic change  Use frequencies to weight penalties and rewards (adding precision to statement like, “[they] contribute to indeterminacy: /t/ with perceptually vulnerable cues and /l/ with stretched out features,” Hume, 2004, p.223)  Generate all instances of metathesis within a language 18

Croft, W. (2000). Explaining Language Change: An Evolutionary Approach. Harlow, England: Pearson. Hume, E. (2004). The Indeterminancy/Attestation Model of Metathesis. Language 80(2):