Multi-objective Optimization

Slides:



Advertisements
Similar presentations
LIAL HORNSBY SCHNEIDER
Advertisements

Introduction to Sensitivity Analysis Graphical Sensitivity Analysis
Optimization of thermal processes2007/2008 Optimization of thermal processes Maciej Marek Czestochowa University of Technology Institute of Thermal Machinery.
Linear Inequalities and Linear Programming Chapter 5 Dr.Hayk Melikyan/ Department of Mathematics and CS/ Linear Programming in two dimensions:
Linear Programming Models: Graphical Methods
Multi-objective optimization multi-criteria decision-making.
Introduction to Mathematical Programming OR/MA 504 Chapter 6 Goal programming and Multiple Objective Optimization.
MAE 552 Heuristic Optimization Instructor: John Eddy Lecture #35 4/26/02 Multi-Objective Optimization.
Marginal Analysis for Optimal Decision Making
Support Vector Machines Formulation  Solve the quadratic program for some : min s. t.,, denotes where or membership.  Different error functions and measures.
Copyright © 2008 by the McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Managerial Economics, 9e Managerial Economics Thomas Maurice.
Lecture outline Support vector machines. Support Vector Machines Find a linear hyperplane (decision boundary) that will separate the data.
Goal Programming and Multiple Objective Optimization
Linear Programming Applications
D Nagesh Kumar, IIScOptimization Methods: M2L5 1 Optimization using Calculus Kuhn-Tucker Conditions.
D Nagesh Kumar, IIScOptimization Methods: M7L1 1 Integer Programming All Integer Linear Programming.
D Nagesh Kumar, IIScOptimization Methods: M3L1 1 Linear Programming Preliminaries.
Introduction and Basic Concepts
D Nagesh Kumar, IIScOptimization Methods: M3L4 1 Linear Programming Simplex method - II.
Linear Programming Applications
Objectives: Set up a Linear Programming Problem Solve a Linear Programming Problem.
A New Algorithm for Solving Many-objective Optimization Problem Md. Shihabul Islam ( ) and Bashiul Alam Sabab ( ) Department of Computer Science.
Multipurpose Water Resource Systems
Stevenson and Ozgur First Edition Introduction to Management Science with Spreadsheets McGraw-Hill/Irwin Copyright © 2007 by The McGraw-Hill Companies,
Chapter 3: Marginal Analysis for Optimal Decision
1 CRP 834: Decision Analysis Week Eight Notes. 2 Plan Evaluation Methods Monetary-based technique Financial Investment Appraisal Cost-effective analysis.
Chapter 6 Production. ©2005 Pearson Education, Inc. Chapter 62 Topics to be Discussed The Technology of Production Production with One Variable Input.
6.1 Chapter 7 – The Theory of Consumer Behavior  The Theory of Consumer behavior provides the theoretical basis for buyer decision- making and the foundation.
D Nagesh Kumar, IIScOptimization Methods: M1L3 1 Introduction and Basic Concepts (iii) Classification of Optimization Problems.
L4 Graphical Solution Homework See new Revised Schedule Review Graphical Solution Process Special conditions Summary 1 Read for W for.
Linear Programming An Example. Problem The dairy "Fior di Latte" produces two types of cheese: cheese A and B. The dairy company must decide how many.
Ken YoussefiMechanical Engineering Dept. 1 Design Optimization Optimization is a component of design process The design of systems can be formulated as.
Goal Programming Linear program has multiple objectives, often conflicting in nature Target values or goals can be set for each objective identified Not.
D Nagesh Kumar, IIScOptimization Methods: M3L2 1 Linear Programming Graphical method.
Linear Programming Revised Simplex Method, Duality of LP problems and Sensitivity analysis D Nagesh Kumar, IISc Optimization Methods: M3L5.
D Nagesh Kumar, IIScOptimization Methods: M2L4 1 Optimization using Calculus Optimization of Functions of Multiple Variables subject to Equality Constraints.
D Nagesh Kumar, IIScOptimization Methods: M4L4 1 Linear Programming Applications Structural & Water Resources Problems.
D Nagesh Kumar, IIScOptimization Methods: M6L5 1 Dynamic Programming Applications Capacity Expansion.
(iii) Lagrange Multipliers and Kuhn-tucker Conditions D Nagesh Kumar, IISc Introduction to Optimization Water Resources Systems Planning and Management:
Fuzzy Optimization D Nagesh Kumar, IISc Water Resources Planning and Management: M9L1 Advanced Topics.
Linear Programming and Applications
Water Resources System Modeling
Stochastic Optimization
Multi-objective Optimization
Introduction to Optimization
(i) Preliminaries D Nagesh Kumar, IISc Water Resources Planning and Management: M3L1 Linear Programming and Applications.
Linear Programming Department of Business Administration FALL by Asst. Prof. Sami Fethi.
Linear Programming and Applications
Water Resources Planning and Management Daene C. McKinney Multipurpose Water Resource Systems.
D Nagesh Kumar, IIScOptimization Methods: M8L1 1 Advanced Topics in Optimization Piecewise Linear Approximation of a Nonlinear Function.
© 2009 Prentice-Hall, Inc. 7 – 1 Decision Science Chapter 3 Linear Programming: Maximization and Minimization.
Sullivan Algebra and Trigonometry: Section 12.9 Objectives of this Section Set Up a Linear Programming Problem Solve a Linear Programming Problem.
Introduction and Preliminaries D Nagesh Kumar, IISc Water Resources Planning and Management: M4L1 Dynamic Programming and Applications.
1 Geometrical solution of Linear Programming Model.
D Nagesh Kumar, IISc Water Resources Systems Planning and Management: M2L2 Introduction to Optimization (ii) Constrained and Unconstrained Optimization.
(iii) Simplex method - I D Nagesh Kumar, IISc Water Resources Planning and Management: M3L3 Linear Programming and Applications.
Linear Programming Models: Graphical and Computer Methods 7 To accompany Quantitative Analysis for Management, Twelfth Edition, by Render, Stair, Hanna.
An Introduction to Linear Programming
Learning Objectives Define several key concepts and terminology related to marginal analysis Use marginal analysis to find optimal activity levels in unconstrained.
Linear Programming Revised Simplex Method, Duality of LP problems and Sensitivity analysis D Nagesh Kumar, IISc Optimization Methods: M3L5.
Mathematical Programming
Linear Programming Dr. T. T. Kachwala.
Demand Theory II Meeghat Habibian Transportation Demand Analysis
3-3 Optimization with Linear Programming
Dynamic Programming and Applications
Linear Programming I: Simplex method
Linear Programming Example: Maximize x + y x and y are called
Chapter 3: Marginal Analysis for Optimal Decision
Chapter 3 Marginal Analysis for Optimal Decisions
Marginal Analysis for Optimal Decision Making
Presentation transcript:

Multi-objective Optimization Introduction Water Resources Planning and Management: M5L1 D Nagesh Kumar, IISc

Objectives To discuss and formulate Multi-objective optimization problems To define pareto-optimal or non-inferior solutions Water Resources Planning and Management: M5L1 D Nagesh Kumar, IISc

Introduction In a real world problem single objective and multiple constraints problems are not common The rigidity provided by the General Problem (GP) is, many a times, far away from the practical design problems. In many of the water resources optimization problems maximizing aggregated net benefits is a common objective. At the same time maximizing water quality, regional development, resource utilization, and various social issues are other objectives which are to be maximized. Water Resources Planning and Management: M5L1 D Nagesh Kumar, IISc

Introduction… There may be conflicting objectives along with the main objective like irrigation, hydropower, recreation etc. Multiple objectives or parameters have to be met before any acceptable solution can be obtained. The word “acceptable” implicates that there is normally no single solution to the problems of the above type Methods of multi-criteria or multi-objective analysis are not designed to identify the best solution, but only to provide information on the tradeoffs between given sets of quantitative performance criteria. Water Resources Planning and Management: M5L1 D Nagesh Kumar, IISc

Multi-objective Problem A multi-objective analysis is a vector optimization The objective function is a vector A multi-objective optimization problem with inequality (or equality) constraints may be formulated as: Find (1) which minimizes f1(X), f2(X), … , fk(X) (2) Water Resources Planning and Management: M5L1 D Nagesh Kumar, IISc

Multi-objective Problem… subject to j= 1, 2 , … , m (3) where k denotes the number of objective functions to be minimized and m is the number of constraints. The objective functions and constraints need not be linear Linear objective functions and constraints - Multi-objective Linear Programming (MOLP). For the problems of the type mentioned above the very notion of optimization changes Good trade-offs are to be found rather than a single solution. Water Resources Planning and Management: M5L1 D Nagesh Kumar, IISc

Multi-objective Problem… The most commonly adopted notion of the “optimum” proposed by Pareto is In other words a solution vector X is called optimal if there is no other vector Y that reduces some objective functions without causing simultaneous increase in at least one other objective function. A vector of the decision variable X is called Pareto Optimal (efficient) if there does not exist another Y such that for i = 1, 2, … , k with for at least one j. Water Resources Planning and Management: M5L1 D Nagesh Kumar, IISc

Non-inferior Solutions The various objectives of a multi-objective problem are often non-commensurate and may be in conflict. Trade-offs are necessary to reach consensus or compromise solutions If there are two solutions, one solution may achieve higher levels of certain objectives and lower levels of other objectives For example, a multipurpose reservoir serving for irrigation and hydropower generation can have two conflicting objectives: maximize benefits from power generation and maximize irrigation benefits. Water Resources Planning and Management: M5L1 D Nagesh Kumar, IISc

Non-inferior Solutions… There are three objectives i, j, k. Direction of their increment is also indicated. Surface (which is formed based on constraints) is efficient because no objective can be reduced without a simultaneous increase in at least one of the other objectives k i j Water Resources Planning and Management: M5L1 D Nagesh Kumar, IISc

Non-inferior Solutions… f1(x) f2(x) A B C F E Feasible region Indifference curves D Infeasible region Transformation curve Values of objective functions and decision variables can be visualized by plotting them an enveloping curve Solution X’ is considered non-inferior if and only if there does not exist another solution X” such that fi(x”) ≥ fi(x’) where i = 1,2,…, no:of objective functions. The collection of all non-inferior solutions is termed as the set of non-inferior solutions. Water Resources Planning and Management: M5L1 D Nagesh Kumar, IISc

Non-inferior Solutions… f1(x) f2(x) A B C F E Feasible region Indifference curves D Infeasible region Transformation curve Each point in the feasible region gives a particular set of values for the decision variable, satisfying all the constraints Each point in the transformation curve gives the maximum value of objective function given a particular value to the other objective function. Point F should not be considered, since one can get a better value of f1(x) by moving towards B, or a better value of f2(x) by moving towards C. Portion BECD is the efficient one since a further increase in any objective function is not possible without the decrease of the other. Water Resources Planning and Management: M5L1 D Nagesh Kumar, IISc

Non-inferior Solutions… f1(x) f2(x) A B C F E Feasible region Indifference curves D Infeasible region Transformation curve Solutions on AB portion are inferior in the current case. These solutions are of interest only when some objectives are to be minimized. Final goal is to identify the plans which lie in the transformation curve which is the set of efficient trade-offs Curve corresponds to a specific trade-off or marginal rate of substitution between the objectives. The points B, E and C are points with three different marginal rate of substitution between the two objective functions. Water Resources Planning and Management: M5L1 D Nagesh Kumar, IISc

Non-inferior Solutions… Indifference curves are the curves of equal preference of a decision-maker. Optimal plan or the ‘best compromise solution’ is the one which achieves the highest level of preference of the decision-maker, i.e., point E in the figure. Slope of the transformation curve at point E gives the optimal trade-off. In order to identify the non-inferior solutions in the decision space as well the objective space in which the best compromise solution lie, methods used are (i) weighing method (ii) constraint method Water Resources Planning and Management: M5L1 D Nagesh Kumar, IISc

Example Maximize subject to Water Resources Planning and Management: M5L1 D Nagesh Kumar, IISc

Example… Solution: Two decision variables and two objective functions Feasible region can be found by plotting all the extreme points and the objective function values at each point Feasible region in the decision space and the set of noninferior solutions Water Resources Planning and Management: M5L1 D Nagesh Kumar, IISc

Example… Feasible region in the objective space and the set of noninferior solutions Water Resources Planning and Management: M5L1 D Nagesh Kumar, IISc

Example… Set of noninferior solutions: Four extreme points, Z(x2), Z(x3), Z(x4) and Z(x5) Among these the identification of any particular noninferior solution as the best compromise solution is not possible without any preference information If any preference is available as represented by an indifference surface (as shown in the figure), then one of the point (here point ] can be identified as the best compromise solution. Water Resources Planning and Management: M5L1 D Nagesh Kumar, IISc

Thank You Water Resources Planning and Management: M5L1 D Nagesh Kumar, IISc