Applications of Evolutionary Computation in the Analysis of Factors Influencing the Evolution of Human Language Alex Decker.

Slides:



Advertisements
Similar presentations
Agent-based Modeling: A Brief Introduction Louis J. Gross The Institute for Environmental Modeling Departments of Ecology and Evolutionary Biology and.
Advertisements

Genetic Algorithms (Evolutionary Computing) Genetic Algorithms are used to try to “evolve” the solution to a problem Generate prototype solutions called.
CS6800 Advanced Theory of Computation
Using Parallel Genetic Algorithm in a Predictive Job Scheduling
Student : Mateja Saković 3015/2011.  Genetic algorithms are based on evolution and natural selection  Evolution is any change across successive generations.
Parameter control Chapter 8. A.E. Eiben and J.E. Smith, Introduction to Evolutionary Computing Parameter Control in EAs 2 Motivation 1 An EA has many.
Parameter Control A.E. Eiben and J.E. Smith, Introduction to Evolutionary Computing Chapter 8.
Variance reduction techniques. 2 Introduction Simulation models should be coded such that they are efficient. Efficiency in terms of programming ensures.
Introduction to Linguistics and Basic Terms
Chapter 4 DECISION SUPPORT AND ARTIFICIAL INTELLIGENCE
A Heuristic Bidding Strategy for Multiple Heterogeneous Auctions Patricia Anthony & Nicholas R. Jennings Dept. of Electronics and Computer Science University.
Knowledge Acquisitioning. Definition The transfer and transformation of potential problem solving expertise from some knowledge source to a program.
Introduction to Genetic Algorithms Yonatan Shichel.
Ch3: Software Engineering Principles 1 What is a principle?  Definition:  Goals of accounting principles:  Goals of software engineering principles?
Evolving Agents in a Hostile Environment Alex J. Berry.
MAE 552 – Heuristic Optimization
Creating Architectural Descriptions. Outline Standardizing architectural descriptions: The IEEE has published, “Recommended Practice for Architectural.
Simulation Models as a Research Method Professor Alexander Settles.
Evolutionary Computational Intelligence Lecture 8: Memetic Algorithms Ferrante Neri University of Jyväskylä.
Evolving a Faster Keyboard Christopher P Walker. Overview Motivation Algorithm Considerations Design of the EA The nonexistent preliminary results Future.
Evolving Agents in a Hostile Environment Alex J. Berry.
Genetic Programming.
1 Reasons for parallelization Can we make GA faster? One of the most promising choices is to use parallel implementations. The reasons for parallelization.
Genetic Algorithm.
Computer Implementation of Genetic Algorithm
Evolutionary Intelligence
1 An Overview of Evolutionary Computation 조 성 배 연세대학교 컴퓨터과학과.
SOFT COMPUTING (Optimization Techniques using GA) Dr. N.Uma Maheswari Professor/CSE PSNA CET.
Evolution Strategies Evolutionary Programming Genetic Programming Michael J. Watts
CS 484 – Artificial Intelligence1 Announcements Lab 3 due Tuesday, November 6 Homework 6 due Tuesday, November 6 Lab 4 due Thursday, November 8 Current.
Lecture 8: 24/5/1435 Genetic Algorithms Lecturer/ Kawther Abas 363CS – Artificial Intelligence.
GATree: Genetically Evolved Decision Trees 전자전기컴퓨터공학과 데이터베이스 연구실 G 김태종.
Spatial ABM H-E Interactions Dawn Parker, George Mason University Participatory agent-based modeling applied to human-environment interactions April 8,
Mary Beth Kurz, PhD Assistant Professor Department of Industrial Engineering Clemson University Utilizing Condor to Support Genetic Algorithm Design Research.
Zorica Stanimirović Faculty of Mathematics, University of Belgrade
ART – Artificial Reasoning Toolkit Evolving a complex system Marco Lamieri Spss training day
Optimization Problems - Optimization: In the real world, there are many problems (e.g. Traveling Salesman Problem, Playing Chess ) that have numerous possible.
Ultrasonic Beam-forming with the Genetic Algorithm Andrew Fiss, Vassar College Nathan Baxter, Ohio Northern University Jerry Magnan, Florida State University.
Fuzzy Genetic Algorithm
Evolving Virtual Creatures & Evolving 3D Morphology and Behavior by Competition Papers by Karl Sims Presented by Sarah Waziruddin.
Soft Computing A Gentle introduction Richard P. Simpson.
Neural and Evolutionary Computing - Lecture 9 1 Evolutionary Neural Networks Design  Motivation  Evolutionary training  Evolutionary design of the architecture.
Genetic Algorithms. Evolutionary Methods Methods inspired by the process of biological evolution. Main ideas: Population of solutions Assign a score or.
Project funded by the Future and Emerging Technologies arm of the IST Programme FET-Open scheme Project funded by the Future and Emerging Technologies.
Design Model Lecture p6 T120B pavasario sem.
/ 26 Evolutionary Computing Chapter 8. / 26 Chapter 8: Parameter Control Motivation Parameter setting –Tuning –Control Examples Where to apply parameter.
1-1 Software Development Objectives: Discuss the goals of software development Identify various aspects of software quality Examine two development life.
Chapter 4 Decision Support System & Artificial Intelligence.
Genetic Algorithms. The Basic Genetic Algorithm 1.[Start] Generate random population of n chromosomes (suitable solutions for the problem) 2.[Fitness]
D Nagesh Kumar, IIScOptimization Methods: M8L5 1 Advanced Topics in Optimization Evolutionary Algorithms for Optimization and Search.
PSY 432: Personality Chapter 1: What is Personality?
Complexity and Hierarchy
Organic Evolution and Problem Solving Je-Gun Joung.
WHAT IS RESEARCH? According to Redman and Morry,
Genetic Algorithm Dr. Md. Al-amin Bhuiyan Professor, Dept. of CSE Jahangirnagar University.
Artificial Intelligence By Mr. Ejaz CIIT Sahiwal Evolutionary Computation.
1 Comparative Study of two Genetic Algorithms Based Task Allocation Models in Distributed Computing System Oğuzhan TAŞ 2005.
Advanced AI – Session 6 Genetic Algorithm By: H.Nematzadeh.
EVOLUTIONARY SYSTEMS AND GENETIC ALGORITHMS NAME: AKSHITKUMAR PATEL STUDENT ID: GRAD POSITION PAPER.
An Evolutionary Algorithm for Neural Network Learning using Direct Encoding Paul Batchis Department of Computer Science Rutgers University.
Psychology Unit 1 Vocabulary. Unit 1 - Psychology 1. Applied research 2. Basic research 3. Biological perspective 4. Cognitive perspective 5. Functionalism.
Genetic Algorithm. Outline Motivation Genetic algorithms An illustrative example Hypothesis space search.
 Presented By: Abdul Aziz Ghazi  Roll No:  Presented to: Sir Harris.
Hirophysics.com The Genetic Algorithm vs. Simulated Annealing Charles Barnes PHY 327.
Evolution Strategies Evolutionary Programming
Advanced Artificial Intelligence Evolutionary Search Algorithm
Evolving Logical-Linear Edge Detector with Evolutionary Algorithms
A Gentle introduction Richard P. Simpson
Lecture 4. Niching and Speciation (1)
Coevolutionary Automated Software Correction
Presentation transcript:

Applications of Evolutionary Computation in the Analysis of Factors Influencing the Evolution of Human Language Alex Decker

Motivating Questions What are the major factors influencing the evolution of a single language over time? What are the major factors influencing the evolution of a single language over time? How can Evolutionary Computation be utilized to explore the dynamics of these factors? How can Evolutionary Computation be utilized to explore the dynamics of these factors?

Associated work The Emergence of Communication by Bruce J. MacLennan used a system of agents with their own unique perspectives on an environment and attempted to allow communication to emerge. He contrived circumstances to give an indirect advantage to those communicating and thus make them more likely to survive. The Emergence of Communication by Bruce J. MacLennan used a system of agents with their own unique perspectives on an environment and attempted to allow communication to emerge. He contrived circumstances to give an indirect advantage to those communicating and thus make them more likely to survive.

Associated work (cont.) However, in MacLennan’s work, the communication between agents was inherently meaningless to those outside the system However, in MacLennan’s work, the communication between agents was inherently meaningless to those outside the system I have made changes that allow entirely different analyses and conclusions based on actual language semantics. I have made changes that allow entirely different analyses and conclusions based on actual language semantics.

Different Approach This is not a typical EA which tries to optimize a group of individuals in a single population. This is not a typical EA which tries to optimize a group of individuals in a single population. My idea is to have an EA that can operate independently across multiple agents and and optimize their vocabulary in terms of the others, and in terms of their own internal parameters. My idea is to have an EA that can operate independently across multiple agents and and optimize their vocabulary in terms of the others, and in terms of their own internal parameters. These agents can then be used to perform other experiments. These agents can then be used to perform other experiments.

Agent Concept Art

Specific base techniques Using independent agents with vocabularies based on the same set of phrases but which are allowed to evolve independently. Using independent agents with vocabularies based on the same set of phrases but which are allowed to evolve independently. Note: Some factors can and should cause agents to adapt their vocabulary along the same lines as other agents; indeed, they learn from each other’s successes and mistakes. This is one of the more interesting aspects of the research. Note: Some factors can and should cause agents to adapt their vocabulary along the same lines as other agents; indeed, they learn from each other’s successes and mistakes. This is one of the more interesting aspects of the research.

Elements of Language A phonic analysis of syllables is used as a basis for both evolution of phrases (tried to keep the same or similar sounds) and comprehension of statements (does what was said sound like anything I know?). A phonic analysis of syllables is used as a basis for both evolution of phrases (tried to keep the same or similar sounds) and comprehension of statements (does what was said sound like anything I know?). Context is implicitly considered when agents attempt to decipher phrases. Context is implicitly considered when agents attempt to decipher phrases.

Simplifications I devised my own method of encoding phonics in the simplest terms. I devised my own method of encoding phonics in the simplest terms. Only the core sounds are encoded with exactly one sound per syllable Only the core sounds are encoded with exactly one sound per syllable Ignoring diphthongs and more complex forms for now Ignoring diphthongs and more complex forms for now

Design / Implementation Static parameters of agents, used to manually influence agent behavior: Adaptability (how willing an agent is to accept reasonable differences) Adaptability (how willing an agent is to accept reasonable differences) Impressionability (how likely an agent is to adopt understood differences as part of his vocabulary) Impressionability (how likely an agent is to adopt understood differences as part of his vocabulary) Acceptance (how willing an agent is to associate with those outside his community) Acceptance (how willing an agent is to associate with those outside his community)

Design / Implementation (cont.) Dynamic parameters of agents, used in evaluation of a given vocabulary (remembering that it is optimized specifically for that agent): Prestige (how well liked the agent is within his community). Prestige (how well liked the agent is within his community). Respectability (how well liked the agent is outside his community). Respectability (how well liked the agent is outside his community).

Design / Implementation (cont.) Phrases are classified into groups (nouns, verbs, etc.) which have well defined forms. Phrases are classified into groups (nouns, verbs, etc.) which have well defined forms. These phrases are then combined into statements. These phrases are then combined into statements. Various statement types are supported (questions, assertions, etc.) Various statement types are supported (questions, assertions, etc.) Each statement type is made up of various (some possibly optional) sub-phrase types which are selected at random. Each statement type is made up of various (some possibly optional) sub-phrase types which are selected at random.

Genetic Operators: Mutation Letter combinations at the beginning and end of a word can be swapped between phrases with similar forms, independent of type. Letter combinations at the beginning and end of a word can be swapped between phrases with similar forms, independent of type. Words not listed as “common” (a, an, etc.) can be replaced with entirely random words created according to loose rules. Words not listed as “common” (a, an, etc.) can be replaced with entirely random words created according to loose rules.

Genetic Operators: Recombination Entire words can be swapped between phrases with similar forms. Entire words can be swapped between phrases with similar forms. New sentence types can be generated by performing crossover between existing types. New sentence types can be generated by performing crossover between existing types.

Two-Phase Experiment The first phase, similar for all runs, will consist of population generation, classification and normalization. The first phase, similar for all runs, will consist of population generation, classification and normalization. The population will be generated either at random, or using a heuristic to guide the population. The population will be generated either at random, or using a heuristic to guide the population. Classification is the emergence of communities. Classification is the emergence of communities. Normalization is the killing off of agents who don’t exhibit desired properties. Normalization is the killing off of agents who don’t exhibit desired properties. Ex: Depending on the second phase, may want different types of communities, different levels of stability, etc. Ex: Depending on the second phase, may want different types of communities, different levels of stability, etc.

A Phase One Classification Cycle Agent selects or creates a statement form. Agent selects or creates a statement form. Agent selects phrases to satisfy this form. Agent selects phrases to satisfy this form. Agent may perform recombination and mutation on these phrases. Agent may perform recombination and mutation on these phrases. Agent communicates the complete sentence to the other agents who respond with the base equivalent sentence they understood as a point of reference. Agent communicates the complete sentence to the other agents who respond with the base equivalent sentence they understood as a point of reference.

Two-Phase Experiment The second phase will differ based on the experiment. The second phase will differ based on the experiment. It will use the evolved and classified populations to analyze the effects of various environmental factors on the agents’ vocabularies. It will use the evolved and classified populations to analyze the effects of various environmental factors on the agents’ vocabularies. Ex: School vs. Home Ex: School vs. Home Ex: Friends vs. Coworkers Ex: Friends vs. Coworkers

Phase Two Examples You could develop two roughly equivalent (but naturally, different) phase one groups and then initiate communication between them. This could be used to simulate the compatibility of different dialects. You could develop two roughly equivalent (but naturally, different) phase one groups and then initiate communication between them. This could be used to simulate the compatibility of different dialects. You could create two phase one groups with differing ranges for their static characteristics and thereby analyze communication between (for example) different socio-economic castes. You could create two phase one groups with differing ranges for their static characteristics and thereby analyze communication between (for example) different socio-economic castes.

ResultsInterestingResults 1 < 2 T 1.7f == 1.7 F M_PI == 4 nope spilled milk public grieving stub toe ouch

Questions for Future Consideration How do changes observed in the artificial world correlate to those observed in the real world? How do changes observed in the artificial world correlate to those observed in the real world? Can these correlations be used to automate the tuning of the EA to produce more accurate changes? Can these correlations be used to automate the tuning of the EA to produce more accurate changes? If the’re don’t, cant you fix it..? If the’re don’t, cant you fix it..? Can these resulting methodologies then be used to simulate the interaction of different languages over time? Can these resulting methodologies then be used to simulate the interaction of different languages over time?

The End Finally Finally