Hirophysics.com The Genetic Algorithm vs. Simulated Annealing Charles Barnes PHY 327.

Slides:



Advertisements
Similar presentations
Genetic Algorithms Chapter 3. A.E. Eiben and J.E. Smith, Introduction to Evolutionary Computing Genetic Algorithms GA Quick Overview Developed: USA in.
Advertisements

Local Search Algorithms
Genetic Algorithms Vida Movahedi November Contents What are Genetic Algorithms? From Biology … Evolution … To Genetic Algorithms Demo.
CS6800 Advanced Theory of Computation
Exact and heuristics algorithms
Genetic Algorithms Representation of Candidate Solutions GAs on primarily two types of representations: –Binary-Coded –Real-Coded Binary-Coded GAs must.
Non-Linear Problems General approach. Non-linear Optimization Many objective functions, tend to be non-linear. Design problems for which the objective.
1 Lecture 8: Genetic Algorithms Contents : Miming nature The steps of the algorithm –Coosing parents –Reproduction –Mutation Deeper in GA –Stochastic Universal.
COMP305. Part II. Genetic Algorithms. Genetic Algorithms.
Evolutionary Computational Intelligence
Optimization via Search CPSC 315 – Programming Studio Spring 2009 Project 2, Lecture 4 Adapted from slides of Yoonsuck Choe.
A new crossover technique in Genetic Programming Janet Clegg Intelligent Systems Group Electronics Department.
Population New Population Selection Crossover and Mutation Insert When the new population is full repeat Generational Algorithm.
1 Genetic Algorithms. CS The Traditional Approach Ask an expert Adapt existing designs Trial and error.
Iterative Improvement Algorithms
Imagine that I am in a good mood Imagine that I am going to give you some money ! In particular I am going to give you z dollars, after you tell me the.
Intro to AI Genetic Algorithm Ruth Bergman Fall 2002.
7/2/2015Intelligent Systems and Soft Computing1 Lecture 9 Evolutionary Computation: Genetic algorithms Introduction, or can evolution be intelligent? Introduction,
Intro to AI Genetic Algorithm Ruth Bergman Fall 2004.
Genetic Algorithm What is a genetic algorithm? “Genetic Algorithms are defined as global optimization procedures that use an analogy of genetic evolution.
Optimization via Search CPSC 315 – Programming Studio Spring 2008 Project 2, Lecture 4 Adapted from slides of Yoonsuck Choe.
S. Mohsen Sadatiyan A., Samuel Dustin Stanley, Donald V. Chase, Carol J. Miller, Shawn P. McElmurry Optimizing Pumping System for Sustainable Water Distribution.
Prepared by Barış GÖKÇE 1.  Search Methods  Evolutionary Algorithms (EA)  Characteristics of EAs  Genetic Programming (GP)  Evolutionary Programming.
Genetic Algorithm.
Evolutionary Intelligence
© Negnevitsky, Pearson Education, CSC 4510 – Machine Learning Dr. Mary-Angela Papalaskari Department of Computing Sciences Villanova University.
Genetic algorithms Prof Kang Li
Optimization in Engineering Design Georgia Institute of Technology Systems Realization Laboratory Mixed Integer Problems Most optimization algorithms deal.
Zorica Stanimirović Faculty of Mathematics, University of Belgrade
Boltzmann Machine (BM) (§6.4) Hopfield model + hidden nodes + simulated annealing BM Architecture –a set of visible nodes: nodes can be accessed from outside.
Genetic Algorithms Genetic algorithms imitate a natural optimization process: natural selection in evolution. Developed by John Holland at the University.
More on Heuristics Genetic Algorithms (GA) Terminology Chromosome –candidate solution - {x 1, x 2,...., x n } Gene –variable - x j Allele –numerical.
Genetic Algorithms Introduction Advanced. Simple Genetic Algorithms: Introduction What is it? In a Nutshell References The Pseudo Code Illustrations Applications.
Genetic Algorithms Siddhartha K. Shakya School of Computing. The Robert Gordon University Aberdeen, UK
Derivative Free Optimization G.Anuradha. Contents Genetic Algorithm Simulated Annealing Random search method Downhill simplex method.
Doshisha Univ., Kyoto, Japan CEC2003 Adaptive Temperature Schedule Determined by Genetic Algorithm for Parallel Simulated Annealing Doshisha University,
GENETIC ALGORITHMS.  Genetic algorithms are a form of local search that use methods based on evolution to make small changes to a popula- tion of chromosomes.
© Negnevitsky, Pearson Education, Lecture 9 Evolutionary Computation: Genetic algorithms Introduction, or can evolution be intelligent? Introduction,
Exact and heuristics algorithms
Learning by Simulating Evolution Artificial Intelligence CSMC February 21, 2002.
 Negnevitsky, Pearson Education, Lecture 9 Evolutionary Computation: Genetic algorithms n Introduction, or can evolution be intelligent? n Simulation.
ECE 103 Engineering Programming Chapter 52 Generic Algorithm Herbert G. Mayer, PSU CS Status 6/4/2014 Initial content copied verbatim from ECE 103 material.
Genetic Algorithms. 2 Overview Introduction To Genetic Algorithms (GAs) GA Operators and Parameters Genetic Algorithms To Solve The Traveling Salesman.
Probabilistic Algorithms Evolutionary Algorithms Simulated Annealing.
EE749 I ntroduction to Artificial I ntelligence Genetic Algorithms The Simple GA.
Genetic Algorithms. The Basic Genetic Algorithm 1.[Start] Generate random population of n chromosomes (suitable solutions for the problem) 2.[Fitness]
Parallel Genetic Algorithms By Larry Hale and Trevor McCasland.
GENETIC ALGORITHM Basic Algorithm begin set time t = 0;
D Nagesh Kumar, IIScOptimization Methods: M8L5 1 Advanced Topics in Optimization Evolutionary Algorithms for Optimization and Search.
Local Search Algorithms and Optimization Problems
Genetic Algorithms. Underlying Concept  Charles Darwin outlined the principle of natural selection.  Natural Selection is the process by which evolution.
Genetic Algorithm Dr. Md. Al-amin Bhuiyan Professor, Dept. of CSE Jahangirnagar University.
The Implementation of Genetic Algorithms to Locate Highest Elevation By Harry Beddo.
Applications of Genetic Algorithms By Harry Beddo 3 rd Quarter.
Artificial Intelligence By Mr. Ejaz CIIT Sahiwal Evolutionary Computation.
Breeding Swarms: A GA/PSO Hybrid 簡明昌 Author and Source Author: Matthew Settles and Terence Soule Source: GECCO 2005, p How to get: (\\nclab.csie.nctu.edu.tw\Repository\Journals-
Genetic Algorithm(GA)
Genetic Algorithm. Outline Motivation Genetic algorithms An illustrative example Hypothesis space search.
Genetic Algorithms and Evolutionary Programming A Brief Overview.
Constraints Satisfaction Edmondo Trentin, DIISM. Constraint Satisfaction Problems: Local Search In many optimization problems, the path to the goal is.
Local search algorithms In many optimization problems, the path to the goal is irrelevant; the goal state itself is the solution State space = set of "complete"
Genetic (Evolutionary) Algorithms CEE 6410 David Rosenberg “Natural Selection or the Survival of the Fittest.” -- Charles Darwin.
Genetic Algorithms.
Evolutionary Algorithms Jim Whitehead
A Comparison of Simulated Annealing and Genetic Algorithm Approaches for Cultivation Model Identification Olympia Roeva.
Intelligent Systems and Soft Computing
EE368 Soft Computing Genetic Algorithms.
Boltzmann Machine (BM) (§6.4)
Md. Tanveer Anwar University of Arkansas
Presentation transcript:

Hirophysics.com The Genetic Algorithm vs. Simulated Annealing Charles Barnes PHY 327

Hirophysics.com The genetic algorithm and simulated annealing processes are used for determining the global minimum and maximum of a selected range for any given function. Finding the min/max of a function Global minimum The function E(x) is equivalent to the internal energy of the system.

Hirophysics.com The genetic algorithm is a computer-performed optimization method that mimics the process of natural evolution. An initial population is generated [A(0):=(A 1 (0), A 2 (0), … A n (0)] Each individual in a population is assigned a fitness function. There are three types of operators for genetic algorithm: 1.Reproduction (Selection) 2.Crossover 3.Mutation Genetic Algorithm

Hirophysics.com Reproduction

Hirophysics.com The crossover operator randomly recombines pairs through mating. Crossover Parents P 1 P | 0111 | | 0100 | 1111 Child 1110 | 0111 | 1111 Parents P 1,2 P | 0111 | | 1101 | 0001 Child 1010 | 0111 | 0001 etc. This is a genetic operator and evolutionary algorithm known as crossover.

Hirophysics.com The mutation operator is a sudden change of chromosome. Mutation A number is randomly switched in the code.

Hirophysics.com There are three main parameters that can be changed in the function of the genetic algorithm: M: the population of a specific farm N: the length of an individual’s binary string k: the temperature interval In addition to these, the function can also itself be changed. The research done on the genetic algorithm was to find which parameters, if any, influenced the production of accurate results. Genetic Algorithm - Parameters

Hirophysics.com Functions Used in Genetic Algorithm

Hirophysics.com The genetic algorithm proved quite accurate on each experiment, producing exceptional results entirely independent of the function. When the variables M, N, and k were changed, little to no effect on the global min/max was observed. The genetic algorithm had no problem finding the minimum and maximum on any type of function. Results – Genetic Algorithm

Hirophysics.com Simulated Annealing

Hirophysics.com The Simulated Annealing Process

Hirophysics.com Finding the global maximum of a function typically produced a graph as follows: Results – Finding the Global Max The graph displays how the solutions converge.

Hirophysics.com Finding the global minimum of a function typically produced a graph as follows: Results – Finding the Global Min The graph displays how the solutions converge.

Hirophysics.com The algorithm used for finding the maximum function was generally more accurate than the minimum algorithm, producing similar graphs with similar maximums each time. e.g. Results – Changing Parameters It is interesting to note that the more calculations done by the algorithm, the faster the convergence is to the solution. 100 Calculations10,000 Calculations

Hirophysics.com Results – Accuracy Max 1 = Min 2 Results of the Algorithms: Graph 1 –(x-2) 2 +3 Graph 2 (x-2) 2 +3 Max 1 =3 at x=2Min 2 =5.04 at x=0.57 

Hirophysics.com Accurate results for both the maximum and minimum simulated annealing algorithms were dependent on functions, as more complicated functions (typically those with powers or exponentials) had trouble producing accurate results In general, the more iterations the algorithm would undergo, the more accurate the final data would be for simpler functions. Finding the maximum via simulated annealing is much more accurate than finding the minimum, though not usually typically accurate. Findings – Simulated Annealing

Hirophysics.com As observed, the genetic algorithm seems to be the most accurate method of the two to find both the maximum and minimum of any function. The simulated annealing process seems to have trouble finding the maximum and minimum of more complicated functions. Conclusion

Hirophysics.com To understand why the simulated annealing algorithm was not accurate, especially at finding the global minimum of a function Future Research