Local and Global Optima

Slides:



Advertisements
Similar presentations
3.4 Linear Programming 10/31/2008. Optimization: finding the solution that is either a minimum or maximum.
Advertisements

Approximation Algorithms
Line Balancing Problem A B C 4.1mins D 1.7mins E 2.7 mins F 3.3 mins G 2.6 mins 2.2 mins 3.4 mins.
MATHEMATICS 3 Operational Analysis Štefan Berežný Applied informatics Košice
Optimization of thermal processes2007/2008 Optimization of thermal processes Maciej Marek Czestochowa University of Technology Institute of Thermal Machinery.
Page 1 Page 1 ENGINEERING OPTIMIZATION Methods and Applications A. Ravindran, K. M. Ragsdell, G. V. Reklaitis Book Review.
Maximum and Minimum Values
1 OR II GSLM Outline  classical optimization – unconstrained optimization  dimensions of optimization  feasible direction.
Lecture 8 – Nonlinear Programming Models Topics General formulations Local vs. global solutions Solution characteristics Convexity and convex programming.
Optimization Problems 虞台文 大同大學資工所 智慧型多媒體研究室. Content Introduction Definitions Local and Global Optima Convex Sets and Functions Convex Programming Problems.
L12 LaGrange Multiplier Method Homework Review Summary Test 1.
Nonlinear Programming
Thursday, April 25 Nonlinear Programming Theory Separable programming Handouts: Lecture Notes.
Frank Cowell: Convexity CONVEXITY MICROECONOMICS Principles and Analysis Frank Cowell 1 March 2012.
Easy Optimization Problems, Relaxation, Local Processing for a small subset of variables.
Water Resources Planning and Management Daene C. McKinney Optimization.
MIT and James Orlin © Nonlinear Programming Theory.
OPTIMAL CONTROL SYSTEMS
MAE 552 – Heuristic Optimization Lecture 4 January 30, 2002.
Exploiting Duality (Particularly the dual of SVM) M. Pawan Kumar VISUAL GEOMETRY GROUP.
Unconstrained Optimization Problem
MAE 552 – Heuristic Optimization Lecture 1 January 23, 2002.
Problem Set # 4 Maximize f(x) = 3x1 + 2 x2 subject to x1 ≤ 4 x1 + 3 x2 ≤ 15 2x1 + x2 ≤ 10 Problem 1 Solve these problems using the simplex tableau. Maximize.
Multivariable Optimization
D Nagesh Kumar, IIScOptimization Methods: M2L5 1 Optimization using Calculus Kuhn-Tucker Conditions.
Maximum and Minimum Values (Section 3.1)
D Nagesh Kumar, IIScOptimization Methods: M2L3 1 Optimization using Calculus Optimization of Functions of Multiple Variables: Unconstrained Optimization.
Optimization Methods One-Dimensional Unconstrained Optimization
Computer Algorithms Mathematical Programming ECE 665 Professor Maciej Ciesielski By DFG.
Tier I: Mathematical Methods of Optimization
Lecture 9 – Nonlinear Programming Models
1 OR II GSLM Outline  separable programming  quadratic programming.
LP formulation of Economic Dispatch
Introduction to Optimization (Part 1)
Absolute Extrema Lesson 6.1. Fencing the Maximum You have 500 feet of fencing to build a rectangular pen. What are the dimensions which give you the most.
1 Example 1 Sketch the graph of the function f(x) = x 3 -3x 2 -45x+47. Solution I. Intercepts The x-intercepts are the solutions to 0= f(x) = x 3 -3x 2.
Essential Question: How do I analyze a polynomial function? Daily Questions: 1). How are turning points related to the degree of a polynomial? 2)How do.
3.4 Linear Programming p Optimization - Finding the minimum or maximum value of some quantity. Linear programming is a form of optimization where.
P I can solve linear programing problem. Finding the minimum or maximum value of some quantity. Linear programming is a form of optimization where.
Pg. 149 Homework Pg. 149#2 – 23 (every 3 rd problem) Pg. 151# #1[-5, 5] by [-2, 10] #4[-4, 4] by [-10, 10] #7[-1,000, 3,000] by [-15,000,000, 2,000,000]
Nonlinear Programming Models
Linear Programming Problem. Definition A linear programming problem is the problem of optimizing (maximizing or minimizing) a linear function (a function.
Polyhedral Optimization Lecture 5 – Part 2 M. Pawan Kumar Slides available online
4.1 – 4.3 Review. Sketch a graph of the quadratic. y = -(x + 3) Find: Vertex (-3, 5) Axis of symmetry x = -3 y - intercept (0, -4) x - intercepts.
Optimality Conditions for Unconstrained optimization One dimensional optimization –Necessary and sufficient conditions Multidimensional optimization –Classification.
Non-Linear Programming © 2011 Daniel Kirschen and University of Washington 1.
LINEAR PROGRAMMING 3.4 Learning goals represent constraints by equations or inequalities, and by systems of equations and/or inequalities, and interpret.
3-5: Linear Programming. Learning Target I can solve linear programing problem.
Instructional Design Document Simplex Method - Optimization STAM Interactive Solutions.
deterministic operations research
Chapter 11 Optimization with Equality Constraints
Mathematical Programming
L11 Optimal Design L.Multipliers
Computational Optimization
Extreme Values of Functions
Lecture 8 – Nonlinear Programming Models
Lecture 9 – Nonlinear Programming Models
Relationship between First Derivative, Second Derivative and the Shape of a Graph 3.3.
Do your homework meticulously!!!
Absolute or Global Maximum Absolute or Global Minimum
3-3 Optimization with Linear Programming
Extreme Values of Functions
Extreme Values of Functions
L5 Optimal Design concepts pt A
Constrained Optimization – Part 1
Compute convex lower bounding function and optimize it instead!
X y y = x2 - 3x Solutions of y = x2 - 3x y x –1 5 –2 –3 6 y = x2-3x.
Extreme Values of Functions
LINEARPROGRAMMING 4/26/2019 9:23 AM 4/26/2019 9:23 AM 1.
Convex and Concave Functions
Presentation transcript:

Local and Global Optima © 2011 Daniel Kirschen and University of Washington

Which one is the real maximum? f(x) A D x © 2011 Daniel Kirschen and University of Washington

Which one is the real optimum? x2 A D x1 B C © 2011 Daniel Kirschen and University of Washington

Local and Global Optima The optimality conditions are local conditions They do not compare separate optima They do not tell us which one is the global optimum In general, to find the global optimum, we must find and compare all the optima In large problems, this can be require so much time that it is essentially an impossible task © 2011 Daniel Kirschen and University of Washington

Convexity If the feasible set is convex and the objective function is convex, there is only one minimum and it is thus the global minimum © 2011 Daniel Kirschen and University of Washington

Examples of Convex Feasible Sets x1min x1max © 2011 Daniel Kirschen and University of Washington

Example of Non-Convex Feasible Sets x1b x1c x1d © 2011 Daniel Kirschen and University of Washington

Example of Convex Feasible Sets A set is convex if, for any two points belonging to the set, all the points on the straight line joining these two points belong to the set x1 x2 x1 x2 x1 x2 x1 x1min x1max © 2011 Daniel Kirschen and University of Washington

Example of Non-Convex Feasible Sets x1b x1c x1d © 2011 Daniel Kirschen and University of Washington

Example of Convex Function f(x) x © 2011 Daniel Kirschen and University of Washington

Example of Convex Function © 2011 Daniel Kirschen and University of Washington

Example of Non-Convex Function f(x) x © 2011 Daniel Kirschen and University of Washington

Example of Non-Convex Function D x1 B C © 2011 Daniel Kirschen and University of Washington

Definition of a Convex Function f(x) z f(y) xa y xb x A convex function is a function such that, for any two points xa and xb belonging to the feasible set and any k such that 0 ≤ k ≤1, we have: © 2011 Daniel Kirschen and University of Washington

Example of Non-Convex Function f(x) x © 2011 Daniel Kirschen and University of Washington

Importance of Convexity If we can prove that a minimization problem is convex: Convex feasible set Convex objective function Then, the problem has one and only one solution Proving convexity is often difficult Power system problems are usually not convex There may be more than one solution to power system optimization problems © 2011 Daniel Kirschen and University of Washington