Self-Configuring Crossover

Slides:



Advertisements
Similar presentations
Population-based metaheuristics Nature-inspired Initialize a population A new population of solutions is generated Integrate the new population into the.
Advertisements

Advanced Mate Selection in Evolutionary Algorithms.
Parameter control Chapter 8. A.E. Eiben and J.E. Smith, Introduction to Evolutionary Computing Parameter Control in EAs 2 Motivation 1 An EA has many.
Parameter Control A.E. Eiben and J.E. Smith, Introduction to Evolutionary Computing Chapter 8.
AUTOMATED REAL-WORLD PROBLEM SOLVING EMPLOYING META-HEURISTICAL BLACK-BOX OPTIMIZATION November 2013 Daniel R. Tauritz, Ph.D. Guest Scientist, Los Alamos.
Linkage Learning in Evolutionary Algorithms. Recombination Missouri University of Science and Technology Recombination explores the search space Classic.
Self-Adaptive Semi-Autonomous Parent Selection (SASAPAS) Each individual has an evolving mate selection function Two ways to pair individuals: –Democratic.
Non-Linear Problems General approach. Non-linear Optimization Many objective functions, tend to be non-linear. Design problems for which the objective.
Futility-Based Offspring Sizing André Nwamba June 13, 2015.
COMP305. Part II. Genetic Algorithms. Genetic Algorithms.
Data Mining CS 341, Spring 2007 Genetic Algorithm.
A new crossover technique in Genetic Programming Janet Clegg Intelligent Systems Group Electronics Department.
EC Awards Lecture ~ Spring 2008 Advances in Parameterless Evolutionary Algorithms Lisa Guntly André Nwamba Research Advisor: Dr. Daniel Tauritz Natural.
Evolutionary Computation Application Peter Andras peter.andras/lectures.
Symposium “New Directions in Evolutionary Computation” Dr. Daniel Tauritz Director, Natural Computation Laboratory Associate Professor, Department of Computer.
A Schema-Based Evolutionary Alg’m. for Black-Box Optimization David A. Cape CS 448, Spring 2008 Missouri S & T.
CS 447 Advanced Topics in Artificial Intelligence Fall 2002.
Genetic Algorithm What is a genetic algorithm? “Genetic Algorithms are defined as global optimization procedures that use an analogy of genetic evolution.
Christoph F. Eick: Applying EC to TSP(n) Example: Applying EC to the TSP Problem  Given: n cities including the cost of getting from on city to the other.
Genetic Algorithm.
Soft Computing Lecture 18 Foundations of genetic algorithms (GA). Using of GA.
Genetic algorithms Prof Kang Li
Lecture 8: 24/5/1435 Genetic Algorithms Lecturer/ Kawther Abas 363CS – Artificial Intelligence.
Genetic Algorithms Michael J. Watts
Optimal resource assignment to maximize multistate network reliability for a computer network Yi-Kuei Lin, Cheng-Ta Yeh Advisor : Professor Frank Y. S.
Genetic Algorithms Genetic Algorithms – What are they? And how they are inspired from evolution. Operators and Definitions in Genetic Algorithms paradigm.
Derivative Free Optimization G.Anuradha. Contents Genetic Algorithm Simulated Annealing Random search method Downhill simplex method.
A New Evolutionary Approach for the Optimal Communication Spanning Tree Problem Sang-Moon Soak Speaker: 洪嘉涓、陳麗徽、李振宇、黃怡靜.
Genetic Algorithms Przemyslaw Pawluk CSE 6111 Advanced Algorithm Design and Analysis
/ 26 Evolutionary Computing Chapter 8. / 26 Chapter 8: Parameter Control Motivation Parameter setting –Tuning –Control Examples Where to apply parameter.
Evolutionary Computation: Genetic Algorithms Copying ideas of Nature Madhu, Natraj,
ECE 103 Engineering Programming Chapter 52 Generic Algorithm Herbert G. Mayer, PSU CS Status 6/4/2014 Initial content copied verbatim from ECE 103 material.
Evolutionary Algorithms K. Ganesh Research Scholar, Ph.D., Industrial Management Division, Humanities and Social Sciences Department, Indian Institute.
Genetic Algorithms. The Basic Genetic Algorithm 1.[Start] Generate random population of n chromosomes (suitable solutions for the problem) 2.[Fitness]
Coevolutionary Automated Software Correction Josh Wilkerson PhD Candidate in Computer Science Missouri S&T.
Solving Function Optimization Problems with Genetic Algorithms September 26, 2001 Cho, Dong-Yeon , Tel:
D Nagesh Kumar, IIScOptimization Methods: M8L5 1 Advanced Topics in Optimization Evolutionary Algorithms for Optimization and Search.
Contribution of second order evolution to evolutionary algorithms Virginie LEFORT July 11 th.
Evolving RBF Networks via GP for Estimating Fitness Values using Surrogate Models Ahmed Kattan Edgar Galvan.
Genetic Algorithms. Underlying Concept  Charles Darwin outlined the principle of natural selection.  Natural Selection is the process by which evolution.
Fitness Guided Fault Localization with Coevolutionary Automated Software Correction Case Study ISC Graduate Student: Josh Wilkerson, Computer Science ISC.
An Evolutionary Algorithm for Neural Network Learning using Direct Encoding Paul Batchis Department of Computer Science Rutgers University.
Breeding Swarms: A GA/PSO Hybrid 簡明昌 Author and Source Author: Matthew Settles and Terence Soule Source: GECCO 2005, p How to get: (\\nclab.csie.nctu.edu.tw\Repository\Journals-
Evolutionary Design of the Closed Loop Control on the Basis of NN-ANARX Model Using Genetic Algoritm.
Genetic Algorithm. Outline Motivation Genetic algorithms An illustrative example Hypothesis space search.
Genetic Algorithm (Knapsack Problem)
Haploid-Diploid Evolutionary Algorithms
Genetic Algorithms.
Advanced Computing and Networking Laboratory
Evolution Strategies Evolutionary Programming
Bulgarian Academy of Sciences
School of Computer Science & Engineering
Example: Applying EC to the TSP Problem
Haploid-Diploid Evolutionary Algorithms
Genetic Algorithms CPSC 212 Spring 2004.
Love before Sex wan ahmad tajuddin wan abdullah
Particle swarm optimization
Example: Applying EC to the TSP Problem
Evolutionary Computation,
Hyper-heuristics Tutorial
Parameter control Chapter 8.
EE368 Soft Computing Genetic Algorithms.
Evolutionary Computation: Genetic Algorithms
Introduction to Genetic Algorithm and Some Experience Sharing
Parameter control Chapter 8.
Beyond Classical Search
Parameter control Chapter 8.
Coevolutionary Automated Software Correction
A Tutorial on Hyper-Heuristics for the Automated Design of Algorithms
Presentation transcript:

Self-Configuring Crossover Brian W. Goldman Daniel R. Tauritz Natural Computation Laboratory - Missouri S&T

Motivation Performance Sensitive to Crossover Selection Identifying & Configuring Best Traditional Crossover is Time Consuming Existing Operators May Be Suboptimal Optimal Operator May Change During Evolution Natural Computation Laboratory - Missouri S&T

Some Possible Solutions Meta-EA Exceptionally time consuming Self-Adaptive Algorithm Selection Limited by algorithms it can choose from Natural Computation Laboratory - Missouri S&T

Self-Configuring Crossover (SCX) Each Individual Encodes a Crossover Operator Crossovers Encoded as a List of Primitives Swap Merge Each Primitive has three parameters Number, Random, or Inline Swap(3, 5, 2) Swap(r, i, r) Merge(1, r, 0.7) Offspring Crossover Natural Computation Laboratory - Missouri S&T

Applying an SCX Natural Computation Laboratory - Missouri S&T Concatenate Genes Parent 1 Genes Parent 2 Genes 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 Natural Computation Laboratory - Missouri S&T

The Swap Primitive Each Primitive has a type First Two Parameters Swap represents crossovers that move genetic material First Two Parameters Start Position End Position Third Parameter Primitive Dependent Swaps use “Width” Swap(3, 5, 2) Natural Computation Laboratory - Missouri S&T

Applying an SCX Natural Computation Laboratory - Missouri S&T 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 Concatenate Genes Swap(r, i, r) Merge(1, r, 0.7) Offspring Crossover 3.0 4.0 5.0 6.0 Swap(3, 5, 2) Natural Computation Laboratory - Missouri S&T

The Merge Primitive Third Parameter Primitive Dependent Merges use “Weight” Random Construct All past primitive parameters used the Number construct “r” marks a primitive using the Random Construct Allows primitives to act stochastically Merge(1, r, 0.7) Natural Computation Laboratory - Missouri S&T

g(i) = α*g(i) + (1-α)*g(j) Applying an SCX 1.0 2.0 5.0 6.0 3.0 4.0 7.0 8.0 Concatenate Genes Swap(3, 5, 2) Swap(r, i, r) Offspring Crossover 0.7 g(i) = α*g(i) + (1-α)*g(j) Merge(1, r, 0.7) g(2) = 6.0*(0.7) + 1.0*(1-0.7) g(1) = 1.0*(0.7) + 6.0*(1-0.7) 2.5 4.5 Natural Computation Laboratory - Missouri S&T

The Inline Construct Only Usable by First Two Parameters Denoted as “i” Forces Primitive to Act on the Same Loci in Both Parents Swap(r, i, r) Natural Computation Laboratory - Missouri S&T

Applying an SCX Natural Computation Laboratory - Missouri S&T 2.5 2.0 5.0 4.5 3.0 4.0 7.0 8.0 Concatenate Genes Merge(1, r, 0.7) Swap(3, 5, 2) Offspring Crossover 2.0 4.0 Swap(r, i, r) Natural Computation Laboratory - Missouri S&T

Applying an SCX Natural Computation Laboratory - Missouri S&T Remove Exess Genes Concatenate Genes 2.5 4.0 5.0 4.5 3.0 2.0 7.0 8.0 Offspring Genes Natural Computation Laboratory - Missouri S&T

Evolving Crossovers Natural Computation Laboratory - Missouri S&T Parent 1 Crossover Swap(4, 2, r) Swap(r, 7, 3) Parent 2 Crossover Merge(r, r, r) Offspring Crossover Merge(1, r, 0.7) Merge(i, 8, r) Swap(3, 5, 2) Swap(r, i, r) Natural Computation Laboratory - Missouri S&T

Empirical Quality Assessment Compared Against Arithmetic Crossover N-Point Crossover Uniform Crossover On Problems Rosenbrock Rastrigin Offset Rastrigin NK-Landscapes DTrap Problem Comparison SCX Rosenbrock -86.94 (54.54) -26.47 (23.33) Rastrigin -59.2 (6.998) -0.0088 (0.021) Offset Rastrigin -0.1175 (0.116) -0.03 (0.028) NK 0.771 (0.011) 0.8016 (0.013) DTrap 0.9782 (0.005) 0.9925 (0.021) Natural Computation Laboratory - Missouri S&T

Adaptations: Rastrigin Natural Computation Laboratory - Missouri S&T

Adaptations: DTrap Natural Computation Laboratory - Missouri S&T

SCX Overhead Requires No Additional Evaluation Adds No Significant Increase in Run Time All linear operations Adds Initial Crossover Length Parameter Testing showed results fairly insensitive to this parameter Even worst settings tested achieved better results than comparison operators Natural Computation Laboratory - Missouri S&T

Conclusions Remove Need to Select Crossover Algorithm Better Fitness Without Significant Overhead Benefits From Dynamically Changing Operator Natural Computation Laboratory - Missouri S&T

Future Work Extension to Permutation Representations Compare With State-of-the-Art Crossovers Test Effectiveness on Real World Problems Further Improve Crossover Evolution Methods Natural Computation Laboratory - Missouri S&T

Questions? Natural Computation Laboratory - Missouri S&T

Fitness: Rastrigin Natural Computation Laboratory - Missouri S&T

Fitness: NK Natural Computation Laboratory - Missouri S&T