Christoph F. Eick: Applying EC to TSP(n) Example: Applying EC to the TSP Problem  Given: n cities including the cost of getting from on city to the other.

Slides:



Advertisements
Similar presentations
Genetic Algorithms Chapter 3. A.E. Eiben and J.E. Smith, Introduction to Evolutionary Computing Genetic Algorithms GA Quick Overview Developed: USA in.
Advertisements

Population-based metaheuristics Nature-inspired Initialize a population A new population of solutions is generated Integrate the new population into the.
Genetic Algorithms Vida Movahedi November Contents What are Genetic Algorithms? From Biology … Evolution … To Genetic Algorithms Demo.
Genetic Algorithm.
CS6800 Advanced Theory of Computation
Exact and heuristics algorithms
Genetic Algorithms Contents 1. Basic Concepts 2. Algorithm
1 APPENDIX A: TSP SOLVER USING GENETIC ALGORITHM.
Tuesday, May 14 Genetic Algorithms Handouts: Lecture Notes Question: when should there be an additional review session?
COMP305. Part II. Genetic Algorithms. Genetic Algorithms.
Evolutionary Computational Intelligence
Population New Population Selection Crossover and Mutation Insert When the new population is full repeat Generational Algorithm.
Iterative Improvement Algorithms
EAs for Combinatorial Optimization Problems BLG 602E.
Artificial Intelligence Genetic Algorithms and Applications of Genetic Algorithms in Compilers Prasad A. Kulkarni.
Iterative Improvement Algorithms For some problems, path to solution is irrelevant: just want solution Start with initial state, and change it iteratively.
CS 447 Advanced Topics in Artificial Intelligence Fall 2002.
Brandon Andrews.  What are genetic algorithms?  3 steps  Applications to Bioinformatics.
Genetic Algorithm.
Genetic Operators for TSP Chapter 8 in Michalewicz and Fogel, How to Solve It: Modern Heuristics, Springer, 2000.
Introduction to Genetic Algorithms and Evolutionary Computation
SOFT COMPUTING (Optimization Techniques using GA) Dr. N.Uma Maheswari Professor/CSE PSNA CET.
1 Local search and optimization Local search= use single current state and move to neighboring states. Advantages: –Use very little memory –Find often.
Intro. ANN & Fuzzy Systems Lecture 36 GENETIC ALGORITHM (1)
Genetic algorithms Prof Kang Li
CS 484 – Artificial Intelligence1 Announcements Lab 3 due Tuesday, November 6 Homework 6 due Tuesday, November 6 Lab 4 due Thursday, November 8 Current.
Ch.12 Machine Learning Genetic Algorithm Dr. Bernard Chen Ph.D. University of Central Arkansas Spring 2011.
Zorica Stanimirović Faculty of Mathematics, University of Belgrade
Boltzmann Machine (BM) (§6.4) Hopfield model + hidden nodes + simulated annealing BM Architecture –a set of visible nodes: nodes can be accessed from outside.
Genetic Algorithms Genetic algorithms imitate a natural optimization process: natural selection in evolution. Developed by John Holland at the University.
Design of an Evolutionary Algorithm M&F, ch. 7 why I like this textbook and what I don’t like about it!
Introduction to Evolutionary Algorithms Session 4 Jim Smith University of the West of England, UK May/June 2012.
Christoph F. Eick: Applications of GAs Ideas for the Transportation Problem  Although the textbook’s initialization procedure has some flaws (which?),
Neural and Evolutionary Computing - Lecture 6
The Generational Control Model This is the control model that is traditionally used by GP systems. There are a distinct number of generations performed.
EE459 I ntroduction to Artificial I ntelligence Genetic Algorithms Kasin Prakobwaitayakit Department of Electrical Engineering Chiangmai University.
1 Combinatorial Problem. 2 Graph Partition Undirected graph G=(V,E) V=V1  V2, V1  V2=  minimize the number of edges connect V1 and V2.
A New Evolutionary Approach for the Optimal Communication Spanning Tree Problem Sang-Moon Soak Speaker: 洪嘉涓、陳麗徽、李振宇、黃怡靜.
Evolution Programs (insert catchy subtitle here).
1 Genetic Algorithms and Ant Colony Optimisation.
Genetic Algorithms Przemyslaw Pawluk CSE 6111 Advanced Algorithm Design and Analysis
Introduction to Genetic Algorithms. Genetic Algorithms We’ve covered enough material that we can write programs that use genetic algorithms! –More advanced.
Edge Assembly Crossover
Genetic Algorithms. 2 Overview Introduction To Genetic Algorithms (GAs) GA Operators and Parameters Genetic Algorithms To Solve The Traveling Salesman.
Chapter 12 FUSION OF FUZZY SYSTEM AND GENETIC ALGORITHMS Chi-Yuan Yeh.
Biologically inspired algorithms BY: Andy Garrett YE Ziyu.
Genetic Algorithms. The Basic Genetic Algorithm 1.[Start] Generate random population of n chromosomes (suitable solutions for the problem) 2.[Fitness]
1 Autonomic Computer Systems Evolutionary Computation Pascal Paysan.
Neural Networks And Its Applications By Dr. Surya Chitra.
1 Contents 1. Basic Concepts 2. Algorithm 3. Practical considerations Genetic Algorithm (GA)
Genetic Algorithms. Underlying Concept  Charles Darwin outlined the principle of natural selection.  Natural Selection is the process by which evolution.
Genetic Algorithm Dr. Md. Al-amin Bhuiyan Professor, Dept. of CSE Jahangirnagar University.
►Search and optimization method that mimics the natural selection ►Terms to define ٭ Chromosome – a set of numbers representing one possible solution ٭
1 Combinatorial Problem. 2 Graph Partition Undirected graph G=(V,E) V=V1  V2, V1  V2=  minimize the number of edges connect V1 and V2.
Artificial Intelligence By Mr. Ejaz CIIT Sahiwal Evolutionary Computation.
Genetic Algorithms. Solution Search in Problem Space.
EVOLUTIONARY SYSTEMS AND GENETIC ALGORITHMS NAME: AKSHITKUMAR PATEL STUDENT ID: GRAD POSITION PAPER.
Genetic Algorithms An Evolutionary Approach to Problem Solving.
Genetic Algorithms And other approaches for similar applications Optimization Techniques.
 Presented By: Abdul Aziz Ghazi  Roll No:  Presented to: Sir Harris.
Genetic (Evolutionary) Algorithms CEE 6410 David Rosenberg “Natural Selection or the Survival of the Fittest.” -- Charles Darwin.
Genetic Algorithms.
Introduction to Evolutionary Computing
Evolutionary Algorithms Jim Whitehead
School of Computer Science & Engineering
Example: Applying EC to the TSP Problem
Example: Applying EC to the TSP Problem
Example: Applying EC to the TSP Problem
Boltzmann Machine (BM) (§6.4)
Presentation transcript:

Christoph F. Eick: Applying EC to TSP(n) Example: Applying EC to the TSP Problem  Given: n cities including the cost of getting from on city to the other city  TSP-Problem: Find a cheapest path that visits every city exactly once  Cost Matrix for Symmetric-5City-TSP-Problem: Solution1: cost: =19 Solution2: cost: =26 Goal: Find the solution with the lowest cost (NP-hard) Remark: A lot of contests:

The Evolutionary Cycle Recombination Mutation Population OffspringParents Selection Replacement

Christoph F. Eick: Applying EC to TSP(n) The Ingredients t t + 1 mutation recombination reproduction selection Fitness function 72 Population Survival of Fittest

Christoph F. Eick: Applying EC to TSP(n) Key Components of an EC System EC System Population Management Genetic Operators Selection Mechanism Chromosomal Representation Given: Fitness Function

Christoph F. Eick: Applying EC to TSP(n) How to use EC for TSP(n)  Fitness function: given  Chromosomal Representation: sequence of numbers containing a permutation of the first n numbers represented as an array; e.g  Selection method: K-tournament selection  Initialization: Random  Evolution Model: Generate the next generation from the scratch  Termination condition: The system is run for N generations and the best (or best k) solution is reported  Operators: mutation, crossover, copy  Operator application probabilities: crossover: 0% at genration 1; increase to 95% at generation N; mutation: 95% at generation 1 is reduced to 0% at generation N; copy: fixed at 5%  Population size PS (e.g. 500)

Christoph F. Eick: Applying EC to TSP(n) The Evolution Mechanism  Increasing diversity by genetic operators  mutation  recombination  Decreasing diversity by selection  of parents  of survivors

Christoph F. Eick: Applying EC to TSP(n) Requirements for TSP-Crossover Operators  Edges that occur in both parents should not be lost.  Introducing new edges that do not occur in any parent should be avoided.  Producing offspring that are very similar to one of the parents but do not have any similarities with the other parent should be avoided.  It is desirable that the crossover operator is complete in the sense that all possible combinations of the features occuring in the two parents can be obtained by a single or a sequence of crossover operations.  The computational complexity of the crossover operator should be low.

Christoph F. Eick: Applying EC to TSP(n) Donor-Receiver-Crossover (DR) 1) Take a path of significant length (e.g. between 1/4 and 1/2 of the chromosome length) from one parent called the donor; this path will be expanded by mostly receiving edges from the other parent, called the receiver. 2) Complete the selected donor path giving preference to higher priority completions: P1: add edges from the receiver at the end of the current path. P2: add edges from the receiver at the beginning of the current path. P3: add edges from the donor at the end of the current path. P4: add edges from the donor at the start of the current path. P5: add an edge including an unassigned city at the end of the path.  The basic idea for this class of operator has been introduced by Muehlenbein.

Christoph F. Eick: Applying EC to TSP(n) Top-Down Edge Preserving Crossovers (TD) 1) Take all edges that occur in both parents. 2) Take legal edges from one parent alternating between parents, as long as possible. 3) Add edges with cities that are still missing.  Michalewicz matrix crossover and many other crossover operators employ this scheme.

Christoph F. Eick: Applying EC to TSP(n) Typical TSP Mutation Operators  Inversion (like standard inversion):  Insertion (selects a city and inserts it a a random place)  Displacement (selects a subtour and inserts it at a random place)  Reciprocal Exchange (swaps two cities) Examples: inversion transforms 12|34567|89 into insertion transform 1>234567|89 into displacement transforms 1>234|5678|9 into reciprocal exchange transforms 1>23456>789 into

Christoph F. Eick: Applying EC to TSP(n) An Evolution Strategy Approach to TSP  advocated by Baeck and Schwefel.  idea: solutions of a particular TSP-problem are represented by a real- valued vectors, from which a path is computed by ordering the numbers in the vector obtaining a sequence of positions.  Example: v=  respesents the sequence:   Traditional ES-operators are employed to conduct the search for the “best” solution.

Christoph F. Eick: Applying EC to TSP(n) Non-GA Approaches for the TSP  Greedy Algorithms:  Start with one city completing the path by adding the cheapest edge at he beginning or at the end..  Start with n>1 cities completing one path by adding the cheapest edge until all cities are included; merge the obtained sub-routes.  Local Optimizations:  Apply 2/3/4/5/... edge optimizations to a complete solution as long as they are beneficiary.  Apply 1/2/3/4/.. step replacements to a complete solution as long as a better solution is obtained. ... (many other possibilities)  Most approaches employ a hill-climbing style search strategy with mutation- style operators.