Introduction to multi-objective optimization We often have more than one objective This means that design points are no longer arranged in strict hierarchy.

Slides:



Advertisements
Similar presentations
PowerPoint Slides by Robert F. BrookerCopyright (c) 2001 by Harcourt, Inc. All rights reserved. Linear Programming Mathematical Technique for Solving Constrained.
Advertisements

GA Approaches to Multi-Objective Optimization
Topic Outline ? Black-Box Optimization Optimization Algorithm: only allowed to evaluate f (direct search) decision vector x objective vector f(x) objective.
Optimization with Constraints
Understanding optimum solution
Integer linear programming Optimization problems where design variables have to be integers are more difficult than ones with continuous variables. The.
Chapter 2: Modeling with Linear Programming & sensitivity analysis
SENSITIVITY ANALYSIS.
Multi-objective optimization multi-criteria decision-making.
Optimality conditions for constrained local optima, Lagrange multipliers and their use for sensitivity of optimal solutions Today’s lecture is on optimality.
Introduction to Linear and Integer Programming
Introduction to multi-objective optimization We often have more than one objective This means that design points are no longer arranged in strict hierarchy.
Multi-objective Approach to Portfolio Optimization 童培俊 张帆.
Multiobjective Optimization Chapter 7 Luke, Essentials of Metaheuristics, 2011 Byung-Hyun Ha R1.
Lecture 10: Sensitivity Part I: General AGEC 352 Spring 2011 – February 28 R. Keeney.
Spring, 2013C.-S. Shieh, EC, KUAS, Taiwan1 Heuristic Optimization Methods Pareto Multiobjective Optimization Patrick N. Ngatchou, Anahita Zarei, Warren.
MAE 552 Heuristic Optimization Instructor: John Eddy Lecture #35 4/26/02 Multi-Objective Optimization.
Multi-Objective Evolutionary Algorithms Matt D. Johnson April 19, 2007.
Introduction to Management Science
Genetic Algorithms in Materials Processing N. Chakraborti Department of Metallurgical & Materials Engineering Indian Institute of Technology Kharagpur.
MAE 552 Heuristic Optimization Instructor: John Eddy Lecture #36 4/29/02 Multi-Objective Optimization.
MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition
On the Task Assignment Problem : Two New Efficient Heuristic Algorithms.
Introduction to Management Science
Introduction and Basic Concepts
A New Algorithm for Solving Many-objective Optimization Problem Md. Shihabul Islam ( ) and Bashiul Alam Sabab ( ) Department of Computer Science.
Chapter 4 Simplex Method for Linear Programming Shi-Shang Jang Chemical Engineering Department National Tsing-Hua University.
Tier I: Mathematical Methods of Optimization
Non-Linear Simultaneous Equations
Linear programming. Linear programming… …is a quantitative management tool to obtain optimal solutions to problems that involve restrictions and limitations.
Arithmetic Sequences and Series
Stevenson and Ozgur First Edition Introduction to Management Science with Spreadsheets McGraw-Hill/Irwin Copyright © 2007 by The McGraw-Hill Companies,
Evolutionary Multi-objective Optimization – A Big Picture Karthik Sindhya, PhD Postdoctoral Researcher Industrial Optimization Group Department of Mathematical.
Chapter 19 Linear Programming McGraw-Hill/Irwin
Linear Regression James H. Steiger. Regression – The General Setup You have a set of data on two variables, X and Y, represented in a scatter plot. You.
1 Linear Programming: Model Formulation and Graphical Solution.
Graphing Linear Inequalities in Two Variables Chapter 4 – Section 1.
Linear Programming Data Structures and Algorithms A.G. Malamos References: Algorithms, 2006, S. Dasgupta, C. H. Papadimitriou, and U. V. Vazirani Introduction.
Introduction to multi-objective optimization We often have more than one objective This means that design points are no longer arranged in strict hierarchy.
Geographic Information Science
Robin McDougall Scott Nokleby Mechatronic and Robotic Systems Laboratory 1.
PowerPoint Slides by Robert F. BrookerHarcourt, Inc. items and derived items copyright © 2001 by Harcourt, Inc. Managerial Economics in a Global Economy.
Kanpur Genetic Algorithms Laboratory IIT Kanpur 25, July 2006 (11:00 AM) Multi-Objective Dynamic Optimization using Evolutionary Algorithms by Udaya Bhaskara.
1 Multi-Objective Portfolio Optimization Jeremy Eckhause AMSC 698S Professor S. Gabriel 6 December 2004.
Arben Asllani University of Tennessee at Chattanooga Chapter 5 Business Analytics with Goal Programming Business Analytics with Management Science Models.
1  Problem: Consider a two class task with ω 1, ω 2   LINEAR CLASSIFIERS.
Log Truck Scheduling Problem
Optimization Optimization is the methodology for obtaining the best alternative from all possible ones. Unconstrained optimization has only an objective.
Multi-objective Optimization
Linear Programming and Applications
Multiobjective Optimization for Locating Multiple Optimal Solutions of Nonlinear Equation Systems and Multimodal Optimization Problems Yong Wang School.
Introduction to Optimization
1 Optimization Techniques Constrained Optimization by Linear Programming updated NTU SY-521-N SMU EMIS 5300/7300 Systems Analysis Methods Dr.
Tamaki Okuda ● Tomoyuki Hiroyasu   Mitsunori Miki   Shinya Watanabe  
Multi-Objective Optimization for Topology Control in Hybrid FSO/RF Networks Jaime Llorca December 8, 2004.
Evolutionary Computing Chapter 12. / 26 Chapter 12: Multiobjective Evolutionary Algorithms Multiobjective optimisation problems (MOP) -Pareto optimality.
Structural & Multidisciplinary Optimization Group Deciding How Conservative A Designer Should Be: Simulating Future Tests and Redesign Nathaniel Price.
ZEIT4700 – S1, 2016 Mathematical Modeling and Optimization School of Engineering and Information Technology.
An Introduction to Linear Programming
Micro Economics in a Global Economy
Chapter 5 Sensitivity Analysis: An Applied Approach
Managerial Economics in a Global Economy
Assignment I TSP with Simulated Annealing
Tables and Relations Review
Heuristic Optimization Methods Pareto Multiobjective Optimization
Linear Programming I: Simplex method
Tables and Relations Review
EEE 244-8: Optimization.
Optimization formulation
Multiobjective Optimization
Presentation transcript:

Introduction to multi-objective optimization We often have more than one objective This means that design points are no longer arranged in strict hierarchy There are points that are clearly poorer than others because all objectives are worse In optimization jargon we call these points dominated Points that are not dominated are called non-dominated or Pareto optimal

Definition of Pareto optimality For a problem with m objective functions, a design variable vector x* is Pareto optimal if and only if there is no vector x in the feasible space with the characteristics

Problem domination We have two objectives that are to be minimized. The following are the pairs of objectives at 10 design points. Mark the non-dominated ones. (67,71) (48,72) (29,88) (-106, 294) (32,13), (-120,163), (103,-30) (-78,114) (-80,143) (75,-171)

Work choice example Item (task)Pay ($)Time (min)Fun index Minimize time and maximize fun so that you make at least $100. Will need between 33.3 to 100 items. Time can vary from 66.7 minutes to 300. Fun can vary between 33.3 and 300.

Example Item (task)Pay ($)/hour Total time (hours) Total fun task 2 is dominated. Tasks 1,3,4 are Pareto optimal

Multi-objective Formulation ItemPayTimeFun

Solution by enumeration In the range of four variables calculate time and fun for all combination that produce exactly $100 Pareto front is upper boundary and it is almost a straight line. Matlab code given in note page.

Pay-fun Problem Formulate the problem of maximizing fun and pay for five hours (300 minutes). Obtain the Pareto front by enumeration and plot. Write the equation for the Pareto front (fun as function of pay).

More efficient solution methods Methods that try to avoid generating the Pareto front –Generate “utopia point” –Define optimum based on some measure of distance from utopia point Generating entire Pareto front –Weighted sum of objectives with variable coefficients –Optimize one objective for a range of constraints on the others –Niching methods with population based algorithms

The utopia point is (66.7,300). One approach is to use it to form a compromise objective as shown above. It gives time=168 minutes, fun=160 (x 3 =76,x 4 =8)

Series of constraints The next slides provides a Matlab segment for solving this optimization problem using the function fmincon.

Matlab segment x0 = [ ]; for fun_idx = 30:5:300 A = [ ; ]; b = [-100;-fun_idx]; lb = zeros(4,1); options = optimset('Display','off'); [x,fval,exitflag,output,lambda] = fmincon('myfun',x0,A,b,[],[],lb,[],[],options); pareto_sol(fun_idx,:) = x; pareto_fun(fun_idx,1) = fval; pareto_fun(fun_idx,2) = 3*x(1) + 2*x(2) + 2*x(3) + x(4); End function f = myfun(x) f = 3*x(1) + 4*x(2) + 2*x(3) + 2*x(4);

Pareto-front Problem Generate the Pareto front for the pay and fun maximization using a series of constraints, and also find a compromise point on it using the utopia point. What is responsible for the slope discontinuity in the Pareto front on Slide 10?