1. Biologically inspired algorithms BY: Andy Garrett YE Ziyu

2. What is Evolutionary Computation A subfield of artificial intelligence which mimics biology Used in optimization of black box problems Parallel processing

3. Types of Evolutionary Computation Evolutionary programing Genetic algorithms Evolutionary strategies Genetic programing Genetic algorithms Swarm intelligence

4. Genetic Algorithms

5. Genetic Algorithm——what is gene? Biology: A certain DNA sequence at a certain position of the chromosome. Genetic Algorithm : A certain value of a certain element of the solution. 23111 23211 23311 A certain element (an allele) of the solution (the chromosome) Three alternative values (genes)

6. Genetic Algorithm——what is gene? BiologyGenetic Algorithm Genes Chromosome Fitness of a individual In the environment Genes Solution Performance of a solution in the problem. (Fitness) constitute determines

7. Genetic Algorithm——what is gene? In Genetic Algorithm, genes (values of elements of the solution) determine the fitness (performance) of a solution. To solve a problem = To find the combination of genes that provides the best fitness (performance)

8. Genetic Algorithm——Initiation To conduct evolution, We need a set of solutions. (A population) Initially, the population is generated randomly. This is the first generation. A two-dimension search space dotted by randomly generated solutions (each solution consists of two elements, x and y) X Y

9. Genetic Algorithm——Reproduction: Crossover Crossover is how we create new individuals from the existing ones. 2 3 1 4 4 1 2 2 1 3 Two solutions somehow be selected as “parents” 2 3 1 4 4 1 2 2 1 3 Randomly select one (or more) point 2 3 2 1 3 1 2 1 4 4 Apply cross (Recombine the two solutions) 2 3 2 1 3 1 2 1 4 4 Finish ！ These will be two Individuals in the next generation

10. Genetic Algorithm——Reproduction: Selection Individuals with higher fitness have a higher probability to be chosen as parents of the crossover operation. Survival of the fittest

11. Genetic Algorithm——Reproduction: Selection What’s the effect? Genes associated with high fitness are more likely to be passed to the new generation. After some generations, the average fitness of the population gets improved!

12. Genetic Algorithm——Reproduction: Selection In a graphic view: (use our two-dimension example) The population gathers around the optimal solution. It’s like that the population is climbing the hill. Problem solved? X Y

13. Genetic Algorithm——Mutation Problem: What if we have multiple hills in the searching space? The individuals may climb onto a hill that is not the highest. Thus, they may gather around a local optimum. Y X Y (Local optimum) (Global optimum)

14. Genetic Algorithm——Mutation According to the crossover operation, genes in the new generation only come from the previous generation. Thus, once the solutions gather around a local optimum, they will be constrained in its vicinity! They won’t find the global optimum. X Y (Constraining region)

15. Genetic Algorithm——Mutation Mutation: Make random changes to some genes in each generation. NEW genes are created! Solutions can jump out of the region. After some generations, they may probably gather around the global optimum. X Y

16. Genetic Algorithm——Scenario Step 1: Initiation (Randomly generate the first generation) ; Step 2: Mutation; Step 3: Fitness evaluation; Step 4: Reproduction: Selection; Crossover; Step 5: Go back to step 2, repeat this loop until a sufficiently good solution is found.

17. Swarm intelligence

18. Swarm Intelligence Swarm intelligence = cognition of individuals + communication Application in optimization problems: Particle Swarm Optimization (PSO)

19. Swarm Intelligence——Initiation Randomly generate a set of solutions (called a swarm of particles ), their initial positions, and their initial speeds. X Y V2 o V3 o V1 o

20. Swarm Intelligence——Travelling Two forces are exerted on each particle: X Y 1. Force pointing to the best solution this particle has ever passed through (pbest) 2. Force pointing to the best solution any particle has ever passed through (gbest) pbestgbest pbest1 pbest2(gbest) pbest3

21. Swarm Intelligence——Travelling Forces pointing to pbests: F p1, F p2, F p3 These forces result from the cognition of individual particles. X Y Fp3 Fp2 Fp1

22. Swarm Intelligence——Travelling Forces pointing to gbests: F g1, F g2, F g3 These forces result from the communication among the particles. X Y Fg3 Fg2 Fg1

23. Swarm Intelligence——Travelling After some time, the particles would probably find some solutions that are sufficiently close the global optimum. X Y Fg3 Fg2 Fg1 Fp3 Fp2 Fp1 https://www.youtube.com/watch?v=j028fsZZZI4

24. Evolutionary Computation Time complexity is not generally considered Number of iterations required for convergence

25. Questions?