5.-7.12.071 Guaranteed Convergence and Distribution in Evolutionary Multi- Objective Algorithms (EMOA’s) via Achivement Scalarizing Functions By Karthik.

Slides:



Advertisements
Similar presentations
University of Jyväskylä Dept. of Mathematical Information Technology
Advertisements

Topic Outline ? Black-Box Optimization Optimization Algorithm: only allowed to evaluate f (direct search) decision vector x objective vector f(x) objective.
Adopt Algorithm for Distributed Constraint Optimization
MOEAs University of Missouri - Rolla Dr. T’s Course in Evolutionary Computation Matt D. Johnson November 6, 2006.
Angers, 10 June 2010 Multi-Objective Optimisation (II) Matthieu Basseur.
CS6800 Advanced Theory of Computation
Multi-Objective Optimization NP-Hard Conflicting objectives – Flow shop with both minimum makespan and tardiness objective – TSP problem with minimum distance,
Elitist Non-dominated Sorting Genetic Algorithm: NSGA-II
Mahyar Shafii December 2007
Optimal Design Laboratory | University of Michigan, Ann Arbor 2011 Design Preference Elicitation Using Efficient Global Optimization Yi Ren Panos Y. Papalambros.
Multiobjective Optimization Chapter 7 Luke, Essentials of Metaheuristics, 2011 Byung-Hyun Ha R1.
INNOVIZATION-Innovative solutions through Optimization Prof. Kalyanmoy Deb & Aravind Srinivasan Kanpur Genetic Algorithm Laboratory (KanGAL) Department.
Approximation and Visualization of Interactive Decision Maps Short course of lectures Alexander V. Lotov Dorodnicyn Computing Center of Russian Academy.
Spring, 2013C.-S. Shieh, EC, KUAS, Taiwan1 Heuristic Optimization Methods Pareto Multiobjective Optimization Patrick N. Ngatchou, Anahita Zarei, Warren.
Multi-Objective Evolutionary Algorithms Matt D. Johnson April 19, 2007.
Department of Engineering, Control & Instrumentation Research Group 22 – Mar – 2006 Optimisation Based Clearance of Nonlinear Flight Control Laws Prathyush.
Design of Curves and Surfaces by Multi Objective Optimization Rony Goldenthal Michel Bercovier School of Computer Science and Engineering The Hebrew University.
MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition
The Pareto fitness genetic algorithm: Test function study Wei-Ming Chen
1 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Classical Exploration Methods for Design Space Exploration (multi-criteria.
Resource Allocation Problem Reporter: Wang Ching Yu Date: 2005/04/07.
A New Algorithm for Solving Many-objective Optimization Problem Md. Shihabul Islam ( ) and Bashiul Alam Sabab ( ) Department of Computer Science.
Multiobjective Optimization Athens 2005 Department of Architecture and Technology Universidad Politécnica de Madrid Santiago González Tortosa Department.
Tier I: Mathematical Methods of Optimization
Optimal Arrangement of Ceiling Cameras for Home Service Robots Using Genetic Algorithms Stefanos Nikolaidis*, ** and Tamio Arai** *R&D Division, Square.
Quality Indicators (Binary ε-Indicator) Santosh Tiwari.
Evolutionary Multi-objective Optimization – A Big Picture Karthik Sindhya, PhD Postdoctoral Researcher Industrial Optimization Group Department of Mathematical.
Stochastic Approximation and Simulated Annealing Lecture 8 Leonidas Sakalauskas Institute of Mathematics and Informatics Vilnius, Lithuania EURO Working.
Helsinki University of Technology Systems Analysis Laboratory Ahti Salo and Antti Punkka Systems Analysis Laboratory Helsinki University of Technology.
On comparison of different approaches to the stability radius calculation Olga Karelkina Department of Mathematics University of Turku MCDM 2011.
2006 Human Competitive Awards (GECCO-2006) 1 Innovization: A Multi-Objective Optimization and Data Analysis Procedure for Unveiling Innovative Design Principles.
Bayesian parameter estimation in cosmology with Population Monte Carlo By Darell Moodley (UKZN) Supervisor: Prof. K Moodley (UKZN) SKA Postgraduate conference,
MOGADES: Multi-Objective Genetic Algorithm with Distributed Environment Scheme Intelligent Systems Design Laboratory , Doshisha University , Kyoto Japan.
Constrained Evolutionary Optimization Yong Wang Associate Professor, PhD School of Information Science and Engineering, Central South University
Advanced Aspects of the Interactive NAUTILUS Method Enabling Gains without Losses Kaisa Miettinen Dmitry Podkopaev University of.
Stochastic Linear Programming by Series of Monte-Carlo Estimators Leonidas SAKALAUSKAS Institute of Mathematics&Informatics Vilnius, Lithuania
Supporting Conceptual Design Innovation through Interactive Evolutionary Systems I.C. Parmee Advanced Computation in Design and Decision-making CEMS, University.
Omni-Optimizer A Procedure for Single and Multi-objective Optimization Prof. Kalyanmoy Deb and Santosh Tiwari.
Robin McDougall Scott Nokleby Mechatronic and Robotic Systems Laboratory 1.
Hybird Evolutionary Multi-objective Algorithms Karthik Sindhya, PhD Postdoctoral Researcher Industrial Optimization Group Department of Mathematical Information.
Locating Multiple Optimal Solutions Based on Multiobjective Optimization Yong Wang
How to apply Genetic Algorithms Successfully Prabhas Chongstitvatana Chulalongkorn University 4 February 2013.
Introduction to Evolutionary Computation Prabhas Chongstitvatana Chulalongkorn University WUNCA, Mahidol, 25 January 2011.
Kanpur Genetic Algorithms Laboratory IIT Kanpur 25, July 2006 (11:00 AM) Multi-Objective Dynamic Optimization using Evolutionary Algorithms by Udaya Bhaskara.
DIVERSITY PRESERVING EVOLUTIONARY MULTI-OBJECTIVE SEARCH Brian Piper1, Hana Chmielewski2, Ranji Ranjithan1,2 1Operations Research 2Civil Engineering.
Evolutionary Design (2) Boris Burdiliak. Topics Representation Representation Multiple objectives Multiple objectives.
1 Multiobjective Optimization, Autumn 2005: Michael Emmerich1 Historical milestones in MCDM and LIACS Projects.
Multiobjective Optimization for Locating Multiple Optimal Solutions of Nonlinear Equation Systems and Multimodal Optimization Problems Yong Wang School.
Multi-objective Evolutionary Algorithms (for NACST/Seq) summarized by Shin, Soo-Yong.
Optimization in Engineering Design 1 Introduction to Non-Linear Optimization.
Tamaki Okuda ● Tomoyuki Hiroyasu   Mitsunori Miki   Shinya Watanabe  
Evolutionary multi-objective algorithm design issues Karthik Sindhya, PhD Postdoctoral Researcher Industrial Optimization Group Department of Mathematical.
HIGH LEVEL SYNTHESIS WITH AREA CONSTRAINTS FOR FPGA DESIGNS: AN EVOLUTIONARY APPROACH Tesi di Laurea di: Christian Pilato Matr.n Relatore: Prof.
Evolutionary Computing Chapter 12. / 26 Chapter 12: Multiobjective Evolutionary Algorithms Multiobjective optimisation problems (MOP) -Pareto optimality.
1 ParadisEO-MOEO for a Bi-objective Flow-Shop Scheduling Problem May 2007 E.-G. Talbi and the ParadisEO team
- Divided Range Multi-Objective Genetic Algorithms -
Multiple-criteria Optimization Lecture 11 (5/11/2016)
Journal of Computational and Applied Mathematics Volume 253, 1 December 2013, Pages 14–25 Reporter : Zong-Dian Lee A hybrid quantum inspired harmony search.
Designing a framework For Recommender system Based on Interactive Evolutionary Computation Date : Mar 20 Sat, 2011 Project Number :
L-Dominance: An Approximate-Domination Mechanism
Balancing of Parallel Two-Sided Assembly Lines via a GA based Approach
The Smart Normal Constraint Method for
Multy- Objective Differential Evolution (MODE)
Assignment I TSP with Simulated Annealing
Heuristic Optimization Methods Pareto Multiobjective Optimization
Multi-Objective Optimization
Key research questions:
University of Jyväskylä Faculty of Information Technology
Chen-Yu Lee, Jia-Fong Yeh, and Tsung-Che Chiang
Multiobjective Optimization
Presentation transcript:

Guaranteed Convergence and Distribution in Evolutionary Multi- Objective Algorithms (EMOA’s) via Achivement Scalarizing Functions By Karthik Sindhya a Thesis Supervisors Prof. Kalyanmoy Deb a Prof. Kaisa Miettinen b a Kanpur Genetic Algorithms Laboratory, IIT Kanpur b Quantitative Methods in Economics, HSE Helsinki GRADUATE SCHOOL SEMINAR

Motivation None of the EMOA’s guarentee to identify optimal trade-offs in finite number of generations even for simple problems. They can only generate a set of solutions whose objective vectors are hopefully not too far away from the optimal objective vectors. Main goal in EMO is to generate only representative set of Pareto solutions for Decision maker (DM), so that, (s)he can get an idea of different trade-offs. Hence it makes less sense to get a large number of points to represent pareto front, as most of EMOAs operate present day, instead a representative set of well distributed Pareto solutions will suffice. Innovization, an important post optimal analysis, is meaningless on hopefully near optimal objective vectors. Main Goals of this study - Provide EMO convergence property While keeping diversity within entire or on partial Pareto optimal set. Achieve both tasks in computationally efficient way.

Literature Survey Literature in the direction of fostering synergy between EMO and MCDM communities has yeilded differernt approaches: Find a preferred solution to the decision maker from a set of non-dominated points generated by EMOA Incorporating preference information in EMOA. STOM in EMO by Tamura (1999), Reference point based EMO by Deb et al. (2006), Interactive EMO and decision making using reference diraction by Deb et al. (2007), First step in the direction of hybridizing EA with scalarizing fitness function to generate approximately efficient solutions was considered by Ishibuchi et al. (1998). Their idea was followed up by Jaszkiewicz (2002) and he proposed multi-objective genetic local search (MOGLS). Ishibuchi et. al.(2006), also proposed an idea of integrating Scalarizing Fitness Functions into EMO algorithms.The idea is to probabilistically using a scalarizing fitness function (weighted sum fitness fucntion) for parent selection and generation update in EMO algorithms.

Proposed Methodology In contemporary stage, methodology executes as a serial process and involves following stages: Execute EMOA to get a non-dominated set which is near Pareto-optimal, The non-dominated set from EMOA is now clustered and a representative set is constructed choosing representative points from each cluster. Pseudo-weight vector (Deb et. al. (2001)) is calculated for the representative set. This preference information is used by means of changing the weights in ASFs. The above procedure cannot guarantee the extreme points of the Pareto-optimal set. Above problem is handled by generating reference points by perturbing the extreme points in the representative set. Procedure is stopped when we do not make any improvements in extreme solutions in successive iterations. Pareto-Point

Initial Studies Two objective test problems (ZDT1,ZDT2 & ZDT3) have been chosen.

Future Work & Conclusion Investigate above approach with More objectives Interactive applications Compare with MOGLS Computational time & accuracy Investigate the procedure with other scalarizing functions Implement concurrent integration Local search as a special operator within EMOA Application to engineering problems Finally, Initial Results are promising and methodology has the capacity to grow into strong rooted procedure to solve Multi-objective problems.

References Deb, K.(2001). Multi-Objective Optimization Using Evolutionary Algorithms. John Wiley & Sons, Chichester. Meittinen, K. (1999). Nonlinear Multiobjective Optimization. Boston: Kluwer. Srinivas, N. and Deb, K. (1994). Multi-objective function optimization using non-dominated sorting genetic algorithms. Evolutionary Computing Journal 2(3), Tamura, H.,Shibata, T., Tomiyama, S., Hatono, I. (1999), A Meta-Heuristic Satisficing Tradeoff Method for Solving Multiobjective Combinatorial Optimization Problems- With Application to Flowshop Scheduling, In Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, vol. 3, pp Deb, K., Sundar, J. (2006). Reference point based multi-objective optimization using evolutionary algorithms. In Proceedings of the Genetic and Evolutionary Computation Conference, pp Deb, K., Kumar, A. (2007). Interactive evolutionary multi-objective optimization and decision making using reference direction method. In Proceedings of the Genetic and Evolutionary Computation Conference, pp Ishibuchi, H., Murata, T. (1998), Multi-objective Genetic Local search Algorithm and Its Application to Flowshop Scheduling. IEEE Transactions on Systems, Man and Cubernetics, 28, 3, Jaszkiewicz, A. (to appear), Genetic local search for multi-objective combinatorial optimization. European Journal of Operation Research. Ishibuchi, H., Doi, T., Nojima, Y.(2006). Incorporation of scalarizing fitness functions into evolutionary multiobjective optimization algorithms, Lecture Notes in Computer Science 4193: Parallel Problem Solving from Nature - PPSN IX, pp Meittinen, K., Mäkelä, MM. (2002). On scalarizing fucntions in multiobjective optimization. OR spectrum, pp Luque, M., Meittinen, K., Eskelinen, P., Ruiz, F. (2007). Incorporating preference information in interactive refernce point methods for multiobjective optimization. Omega, (To appear). Deb, K., Goel, t. (2001). A hybrid multi-objective evolutionary approach to engineering shape design. In Proceedings of the Third International Conference on Evolutionary Multi-criterion Optimization (EMO-2001), pp