A Study of Genetic Algorithms for Parameter Optimization

Slides:



Advertisements
Similar presentations
Genetic Algorithms.
Advertisements

CPSC 322, Lecture 16Slide 1 Stochastic Local Search Variants Computer Science cpsc322, Lecture 16 (Textbook Chpt 4.8) February, 9, 2009.
Valery Frolov.  The algorithm  Fitness function  Crossover  Mutation  Elite individuals  Reverse mutations  Some statistics  Run examples.
Non-Linear Problems General approach. Non-linear Optimization Many objective functions, tend to be non-linear. Design problems for which the objective.
Data Mining CS 341, Spring 2007 Genetic Algorithm.
Introduction to Genetic Algorithms Yonatan Shichel.
Artificial Intelligence Genetic Algorithms and Applications of Genetic Algorithms in Compilers Prasad A. Kulkarni.
Research Trends in AI Maze Solving using GA Muhammad Younas Hassan Javaid Danish Hussain
Genetic Algorithms Overview Genetic Algorithms: a gentle introduction –What are GAs –How do they work/ Why? –Critical issues Use in Data Mining –GAs.
Brandon Andrews.  What are genetic algorithms?  3 steps  Applications to Bioinformatics.
Prepared by Barış GÖKÇE 1.  Search Methods  Evolutionary Algorithms (EA)  Characteristics of EAs  Genetic Programming (GP)  Evolutionary Programming.
© Negnevitsky, Pearson Education, CSC 4510 – Machine Learning Dr. Mary-Angela Papalaskari Department of Computing Sciences Villanova University.
A Comparison of Nature Inspired Intelligent Optimization Methods in Aerial Spray Deposition Management Lei Wu Master’s Thesis Artificial Intelligence Center.
1 Local search and optimization Local search= use single current state and move to neighboring states. Advantages: –Use very little memory –Find often.
Optimization in Engineering Design Georgia Institute of Technology Systems Realization Laboratory Mixed Integer Problems Most optimization algorithms deal.
Zorica Stanimirović Faculty of Mathematics, University of Belgrade
Chapter 7 Handling Constraints
Appendix B A BRIEF TOUR OF SOLVER Prescriptive Analytics
Genetic algorithms Charles Darwin "A man who dares to waste an hour of life has not discovered the value of life"
HOW TO MAKE A TIMETABLE USING GENETIC ALGORITHMS Introduction with an example.
Applying Genetic Algorithm to the Knapsack Problem Qi Su ECE 539 Spring 2001 Course Project.
G ENETIC A LGORITHMS Steve Foster. I NTRODUCTION Genetic Algorithms are based on the principals of evolutionary biology in order to find solutions to.
Computational Complexity Jang, HaYoung BioIntelligence Lab.
Evolving Virtual Creatures & Evolving 3D Morphology and Behavior by Competition Papers by Karl Sims Presented by Sarah Waziruddin.
© Negnevitsky, Pearson Education, Lecture 9 Evolutionary Computation: Genetic algorithms Introduction, or can evolution be intelligent? Introduction,
Genetic Algorithms. Evolutionary Methods Methods inspired by the process of biological evolution. Main ideas: Population of solutions Assign a score or.
Learning by Simulating Evolution Artificial Intelligence CSMC February 21, 2002.
1 Genetic Algorithms K.Ganesh Introduction GAs and Simulated Annealing The Biology of Genetics The Logic of Genetic Programmes Demo Summary.
Genetic Algorithms Czech Technical University in Prague, Faculty of Electrical Engineering Ondřej Vaněk, Agent Technology Center ZUI 2011.
Genetic Algorithms CSCI-2300 Introduction to Algorithms
Improving the Genetic Algorithm Performance in Aerial Spray Deposition Management University of Georgia L. Wu, W.D. Potter, K. Rasheed USDA Forest Service.
Routing and Scheduling in Multistage Networks using Genetic Algorithms Advisor: Dr. Yi Pan Chunyan Ji 3/26/01.
Optimization Problems
Innovative and Unconventional Approach Toward Analytical Cadastre – based on Genetic Algorithms Anna Shnaidman Mapping and Geo-Information Engineering.
Neural Networks And Its Applications By Dr. Surya Chitra.
Genetic Algorithms. Underlying Concept  Charles Darwin outlined the principle of natural selection.  Natural Selection is the process by which evolution.
Genetic Algorithm Dr. Md. Al-amin Bhuiyan Professor, Dept. of CSE Jahangirnagar University.
Agenda  INTRODUCTION  GENETIC ALGORITHMS  GENETIC ALGORITHMS FOR EXPLORING QUERY SPACE  SYSTEM ARCHITECTURE  THE EFFECT OF DIFFERENT MUTATION RATES.
Genetic Algorithms. Overview “A genetic algorithm (or GA) is a variant of stochastic beam search in which successor states are generated by combining.
Artificial Intelligence By Mr. Ejaz CIIT Sahiwal Evolutionary Computation.
Genetic Algorithm(GA)
Genetic Algorithm. Outline Motivation Genetic algorithms An illustrative example Hypothesis space search.
Genetic Algorithms and Evolutionary Programming A Brief Overview.
Presented By: Farid, Alidoust Vahid, Akbari 18 th May IAUT University – Faculty.
Hirophysics.com The Genetic Algorithm vs. Simulated Annealing Charles Barnes PHY 327.
Genetic (Evolutionary) Algorithms CEE 6410 David Rosenberg “Natural Selection or the Survival of the Fittest.” -- Charles Darwin.
Evolutionary Computation Evolving Neural Network Topologies.
Genetic Algorithm (Knapsack Problem)
Optimization Problems
Power Magnetic Devices: A Multi-Objective Design Approach
MAE 552 Heuristic Optimization
Author :Shigeomi HARA Hiroshi DOUZONO Yoshio NOGUCHI
Evolving the goal priorities of autonomous agents
Traffic Simulator Calibration
Intelligent Systems and Soft Computing

Genetic Algorithms, Search Algorithms
Prof. Marie desJardins September 20, 2010
Process modelling and optimization aid
CS621: Artificial Intelligence
Artificial Intelligence Chapter 4. Machine Evolution
Optimization Problems
Genetic Algorithms CSCI-2300 Introduction to Algorithms
Methods and Materials (cont.)
Boltzmann Machine (BM) (§6.4)
Searching for solutions: Genetic Algorithms
Genetic algorithms: case study
Beyond Classical Search
Coevolutionary Automated Software Correction
Presentation transcript:

A Study of Genetic Algorithms for Parameter Optimization Mac Newbold

Introduction Many algorithms have constant values that affect the way they work Sometimes we choose them arbitrarily or based on some experimentation Their interactions are often not well understood Use Genetic Algorithm to optimize the parameters to an algorithm

Background Utah Network Testbed (www.emulab.net) Map a “virtual” topology graph to the physical topology graph NP-Hard, 30+ degrees of freedom “assign” – Simulated Annealing (AI algo.) 19 constants control behaviors 1 boolean, 4 integers, 15 floating point 1 integer and 3 floats are scaling factors 15 parameters need to be optimized

Genetic Algorithm Evolution, “survival of the fittest” Genetic Algorithm control – “tune” Calls object methods Replaceable object Obj->Random() – returns a random object Obj->Fitness() – calculate fitness of object Obj->Cross(obj2) – crossover (returns 2 objs) Obj->Mutate() – mutate Obj->Display() – Show the object Very Flexible Framework

Parameter Optimization “Params” object Specialized for “assign” Contains the 15 variables we want to tune One extra value caches fitness calculations Insures that values “make sense” using domain specific constraints Uniform crossover Random mutation Performance based fitness measure

Fitness Function For “assign”, we care about running time Choice of constants has huge effect Fitness calculation: Run “assign” on a set of N problems, using the object’s parameters Allow S seconds for each run X=Sum of execution times Fitness = (S*N) – X S*N = maximum possible total time Higher scores are better Could take a long time, so cache result

G.A. Results Tested genetic algorithm with “random” objects Same as “Params” object, except for fitness Random fitness, updated after cross/mutate 1000 member population Crossover rate of 0.50 Mutation rate of 0.30 Threshold = 999.995/1000 Took 7 generations, about 5 seconds

Results

What’s Next Finish setting up actual scoring using “assign” runtimes…