A Multiobjective Evolutionary Algorithm Using Gaussian Process based Inverse Modeling Ran Cheng 1, Yaochu Jin 1, Kaname Narukawa 2 and Bernhard Sendhof.

Slides:



Advertisements
Similar presentations
Topic Outline ? Black-Box Optimization Optimization Algorithm: only allowed to evaluate f (direct search) decision vector x objective vector f(x) objective.
Advertisements

Biased Random Key Genetic Algorithm with Hybrid Decoding for Multi-objective Optimization Panwadee Tangpattanakul, Nicolas Jozefowiez, Pierre Lopez LAAS-CNRS.
Optimization of intrusion detection systems for wireless sensor networks using evolutionary algorithms Martin Stehlík Faculty of Informatics Masaryk University.
Multi-objective optimization multi-criteria decision-making.
Proposed concepts illustrated well on sets of face images extracted from video: Face texture and surface are smooth, constraining them to a manifold Recognition.
Surrogate Model Based Differential Evolution for Multiobjective Optimization (GP - DEMO) Šmarna gora, Miha Mlakar Algoritmi po vzorih iz narave.
Optimal Design Laboratory | University of Michigan, Ann Arbor 2011 Design Preference Elicitation Using Efficient Global Optimization Yi Ren Panos Y. Papalambros.
Multiobjective Optimization Chapter 7 Luke, Essentials of Metaheuristics, 2011 Byung-Hyun Ha R1.
Bayesian Robust Principal Component Analysis Presenter: Raghu Ranganathan ECE / CMR Tennessee Technological University January 21, 2011 Reading Group (Xinghao.
Module F: Simulation. Introduction What: Simulation Where: To duplicate the features, appearance, and characteristics of a real system Why: To estimate.
A Study on Recent Fast Ways of Hypervolume Calculation for MOEAs Mainul Kabir ( ) and Nasik Muhammad Nafi ( ) Department of Computer Science.
Spring, 2013C.-S. Shieh, EC, KUAS, Taiwan1 Heuristic Optimization Methods Pareto Multiobjective Optimization Patrick N. Ngatchou, Anahita Zarei, Warren.
A New Evolutionary Algorithm for Multi-objective Optimization Problems Multi-objective Optimization Problems (MOP) –Definition –NP hard By Zhi Wei.
Predictive Automatic Relevance Determination by Expectation Propagation Yuan (Alan) Qi Thomas P. Minka Rosalind W. Picard Zoubin Ghahramani.
Diversity Maintenance Behavior on Evolutionary Multi-Objective Optimization Presenter : Tsung Yu Ho at TEILAB.
MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition
The Pareto fitness genetic algorithm: Test function study Wei-Ming Chen
Bayesian Learning Rong Jin.
Distributed Representations of Sentences and Documents
1 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Classical Exploration Methods for Design Space Exploration (multi-criteria.
Results Classification - Comparison with existing approaches on benchmark datasets Survival Analysis – International multi-centre double-blind study Survival.
A New Algorithm for Solving Many-objective Optimization Problem Md. Shihabul Islam ( ) and Bashiul Alam Sabab ( ) Department of Computer Science.
Evolutionary Multi-objective Optimization – A Big Picture Karthik Sindhya, PhD Postdoctoral Researcher Industrial Optimization Group Department of Mathematical.
Design Space Exploration
Using Genetic Programming to Learn Probability Distributions as Mutation Operators with Evolutionary Programming Libin Hong, John Woodward, Ender Ozcan,
Cooperative Meeting Scheduling among Agents based on Multiple Negotiations Toramatsu SHINTANI and Takayuki ITO Department of Intelligence and Computer.
Constrained Evolutionary Optimization Yong Wang Associate Professor, PhD School of Information Science and Engineering, Central South University
Machine Learning Seminar: Support Vector Regression Presented by: Heng Ji 10/08/03.
A two-stage approach for multi- objective decision making with applications to system reliability optimization Zhaojun Li, Haitao Liao, David W. Coit Reliability.
Chih-Ming Chen, Student Member, IEEE, Ying-ping Chen, Member, IEEE, Tzu-Ching Shen, and John K. Zao, Senior Member, IEEE Evolutionary Computation (CEC),
Locating Multiple Optimal Solutions Based on Multiobjective Optimization Yong Wang
Multidimensional Scaling by Deterministic Annealing with Iterative Majorization Algorithm Seung-Hee Bae, Judy Qiu, and Geoffrey Fox SALSA group in Pervasive.
Robust Pareto Design of GMDH-type Neural Networks for Systems with Probabilistic Uncertainties N. Nariman-zadeh, F. Kalantary, A. Jamali, F. Ebrahimi Faculty.
Kanpur Genetic Algorithms Laboratory IIT Kanpur 25, July 2006 (11:00 AM) Multi-Objective Dynamic Optimization using Evolutionary Algorithms by Udaya Bhaskara.
Sparse Bayesian Learning for Efficient Visual Tracking O. Williams, A. Blake & R. Cipolloa PAMI, Aug Presented by Yuting Qi Machine Learning Reading.
CUHK Learning-Based Power Management for Multi-Core Processors YE Rong Nov 15, 2011.
Pei-Chuan Tsai Chih-Ming Chen Ying-ping Chen WCCI 2012 IEEE World Congress on Computational Intelligence Sparse Degrees Analysis for LT Codes Optimization.
Intelligent Database Systems Lab Advisor : Dr.Hsu Graduate : Keng-Wei Chang Author : Lian Yan and David J. Miller 國立雲林科技大學 National Yunlin University of.
1 Learning Guided Multiobjective Optimization Aimin Zhou East China Normal University, Shanghai, China 7/9, 2015.
Multi-objective Optimization
Multiobjective Optimization for Locating Multiple Optimal Solutions of Nonlinear Equation Systems and Multimodal Optimization Problems Yong Wang School.
INTELLIGENT SIMULATION OF COMPLEX SYSTEMS USING IMMUCOMPUTING Svetlana P. Sokolova Ludmilla A. Sokolova St. Petersburg Institute for Informatics and Automation.
Distributed Rateless Codes with UEP Property Ali Talari, Nazanin Rahnavard 2010 IEEE ISIT(International Symposium on Information Theory) & IEEE TRANSACTIONS.
Neural and Evolutionary Computing - Lecture 9 1 Evolutionary Multiobjective Optimization  Particularities of multiobjective optimization  Multiobjective.
Evolutionary Computing Chapter 12. / 26 Chapter 12: Multiobjective Evolutionary Algorithms Multiobjective optimisation problems (MOP) -Pareto optimality.
1 ParadisEO-MOEO for a Bi-objective Flow-Shop Scheduling Problem May 2007 E.-G. Talbi and the ParadisEO team
Multi-objective evolutionary generation of mamdani fuzzy rule-based systems based on rule and condition selection International Workshop On Genetic And.
Incremental Reduced Support Vector Machines Yuh-Jye Lee, Hung-Yi Lo and Su-Yun Huang National Taiwan University of Science and Technology and Institute.
Designing a framework For Recommender system Based on Interactive Evolutionary Computation Date : Mar 20 Sat, 2011 Project Number :
Date of download: 7/7/2016 Copyright © ASME. All rights reserved. From: An Approach to Identify Six Sigma Robust Solutions of Multi/Many-Objective Engineering.
Pareto-Optimality of Cognitively Preferred Polygonal Hulls for Dot Patterns Antony Galton University of Exeter UK.
Unsupervised Learning Part 2. Topics How to determine the K in K-means? Hierarchical clustering Soft clustering with Gaussian mixture models Expectation-Maximization.
BAHIR DAR UNIVERSITY Institute of technology Faculty of Computing Department of information technology Msc program Distributed Database Article Review.
CS479/679 Pattern Recognition Dr. George Bebis
L-Dominance: An Approximate-Domination Mechanism
Department of Computer Science
Ch3: Model Building through Regression
Boosting and Additive Trees
Rutgers Intelligent Transportation Systems (RITS) Laboratory
Heuristic Optimization Methods Pareto Multiobjective Optimization
CEC 2003 Tatsuya Okabe, Yaochu Jin and Bernhard Sendhoff
Multi-Objective Optimization
Chen-Yu Lee, Jia-Fong Yeh, and Tsung-Che Chiang
Sparse Learning Based on L2,1-norm
A Near-Optimal Sensor Placement Algorithm to Achieve Complete Coverage/Discrimination in Sensor Networks Authors : Frank Y. S. Lin and P. L. Chiu, Student.
RM-MEDA: A Regularity Model-Based Multiobjective Estimation of Distribution Algorithm BISCuit EDA Seminar
MOEA Testing and Analysis
A Block Based MAP Segmentation for Image Compression
Combination of Feature and Channel Compensation (1/2)
Multiobjective Optimization
Presentation transcript:

A Multiobjective Evolutionary Algorithm Using Gaussian Process based Inverse Modeling Ran Cheng 1, Yaochu Jin 1, Kaname Narukawa 2 and Bernhard Sendhof 2 1 Department of Computing, University of Surrey, Guildford, UK 2 Honda Research Institute Europe Offenbach, Germany

Multiobjective Optimization

Key features of multiobjective problems (MOPs) Involving more than one conflicting objectives to be optimized No one single solution optimizes all the objectives A set of non-dominated solutions are used to present the trade-offs between different objectives Advantages of multiobjective evolutionary algorithms Population based nature Capability to obtain a set of solutions in one single run

Multiobjective Optimization Pareto Dominance

The proposed IM-MOEA

Motivations To investigate the possibility of modeling the inverse mapping from the objective space to the decision space To control the distribution of the solutions by directly sampling the Pareto front To do a posteriori sampling for decision making in the objective space and the corresponding solutions in the decision space can be obtained via the inverse models

The proposed IM-MOEA Background “Regularity” property: under KKT condition, for an m- objective problem, both the Pareto front (PF) and the Pareto set (PS) are (m - 1)-D manifolds, i.e., PF and PS are of the same dimensionality The “regularity” property has substantially increased the possibility that the inverse mapping from the (m – 1)-D PF to the (m – 1)-D PS is a “one-to-one” mapping

Inverse Modeling for Multiobjective Optimization Inverse Model Decomposition

Inverse Modeling for Multiobjective Optimization Independent Sampling on Each Objective

Inverse Modeling for Multiobjective Optimization Random Grouping to Capture the Variable Linkages

Inverse Modeling for Multiobjective Optimization Inverse Model Decomposition Each univariate model is realized using the Guassian process

The proposed IM-MOEA Gaussian process regression training and sampling

Inverse Modeling for Multiobjective Optimization Framework of the Inverse Model based MOEA (IM- MOEA)

Experimental results

Conclusion and future work

The proposed IM-MOEA has shown robust performance on a variety of benchmark functions, especially on some complicated functions with variable linkage Its scalability is confirmed by its performance on the 104-D WFG functions It’s a posteriori sampling ability has been confirmed.

Conclusion and future work In the future, we would like to : Extend the proposed IM-MOEA for many-objective problems Articulate user preference into the reference vectors

That is all ! Thanks for your attention. Reference: Ran Cheng, Yaochu Jin, Kaname Narukawa and Bernhard Sendhoff. A Multiobjective Evolutionary Algorithm using Gaussian Process based Inverse Modeling. IEEE Transactions on Evolutionary Computation, 2015 (accepted)