1 Chapter 8 Nonlinear Programming with Constraints.

Slides:



Advertisements
Similar presentations
Optimality conditions for constrained local optima, Lagrange multipliers and their use for sensitivity of optimal solutions.
Advertisements

Engineering Optimization
1 TTK4135 Optimization and control B.Foss Spring semester 2005 TTK4135 Optimization and control Spring semester 2005 Scope - this you shall learn Optimization.
Optimization of thermal processes2007/2008 Optimization of thermal processes Maciej Marek Czestochowa University of Technology Institute of Thermal Machinery.
Convex Optimization Chapter 1 Introduction. What, Why and How  What is convex optimization  Why study convex optimization  How to study convex optimization.
Chapter 9 Perceptrons and their generalizations. Rosenblatt ’ s perceptron Proofs of the theorem Method of stochastic approximation and sigmoid approximation.
Slide 4b.1 Stiff Structures, Compliant Mechanisms, and MEMS: A short course offered at IISc, Bangalore, India. Aug.-Sep., G. K. Ananthasuresh Lecture.
Easy Optimization Problems, Relaxation, Local Processing for a small subset of variables.
Optimality conditions for constrained local optima, Lagrange multipliers and their use for sensitivity of optimal solutions Today’s lecture is on optimality.
Separating Hyperplanes
Inexact SQP Methods for Equality Constrained Optimization Frank Edward Curtis Department of IE/MS, Northwestern University with Richard Byrd and Jorge.
1 Chapter 8: Linearization Methods for Constrained Problems Book Review Presented by Kartik Pandit July 23, 2010 ENGINEERING OPTIMIZATION Methods and Applications.
Economics 214 Lecture 37 Constrained Optimization.
1 Real-Time Optimization (RTO) In previous chapters we have emphasized control system performance for disturbance and set-point changes. Now we will be.
I/O Curve The IO curve plots fuel input (in MBtu/hr) versus net MW output.
Ch. 9: Direction Generation Method Based on Linearization Generalized Reduced Gradient Method Mohammad Farhan Habib NetLab, CS, UC Davis July 30, 2010.
Lecture 16 Economic Dispatch Professor Tom Overbye Department of Electrical and Computer Engineering ECE 476 POWER SYSTEM ANALYSIS.
Optimization of Linear Problems: Linear Programming (LP) © 2011 Daniel Kirschen and University of Washington 1.
EE 369 POWER SYSTEM ANALYSIS
MATH 685/ CSI 700/ OR 682 Lecture Notes Lecture 9. Optimization problems.
1 Least Cost System Operation: Economic Dispatch 2 Smith College, EGR 325 March 10, 2006.
Real-Time Optimization (RTO) In previous chapters we have emphasized control system performance for load and set-point changes. Now we will be concerned.
Frank Edward Curtis Northwestern University Joint work with Richard Byrd and Jorge Nocedal February 12, 2007 Inexact Methods for PDE-Constrained Optimization.
Equality and Inequality Meeting 4. Equations An equation is a statement that two mathematical expressions are equal. The values of the unknown that make.
General Nonlinear Programming (NLP) Software
Business Analytics with Nonlinear Programming
Fin500J: Mathematical Foundations in Finance
Optimization of Process Flowsheets S,S&L Chapter 24 T&S Chapter 12 Terry A. Ring CHEN 5253.
1 Chapter 7 Linear Programming. 2 Linear Programming (LP) Problems Both objective function and constraints are linear. Solutions are highly structured.
Chapter 7 Handling Constraints
SCED Security Constrained Economic Dispatch Linear vs. Quadratic Programming Model.
Announcements Homework 7 is 6.46, 6.49, 6.52, 11.19, 11.21, 11.27; due date is Thursday October 30 Potential spring courses: ECE 431 and ECE 398RES (Renewable.
Frank Edward Curtis Northwestern University Joint work with Richard Byrd and Jorge Nocedal January 31, 2007 Inexact Methods for PDE-Constrained Optimization.
Computer Animation Rick Parent Computer Animation Algorithms and Techniques Optimization & Constraints Add mention of global techiques Add mention of calculus.
Chapter 20 1 Overall Objectives of Model Predictive Control 1.Prevent violations of input and output constraints. 2.Drive some output variables to their.
Part 4 Nonlinear Programming 4.1 Introduction. Standard Form.
A comparison between PROC NLP and PROC OPTMODEL Optimization Algorithm Chin Hwa Tan December 3, 2008.
1 Chapter 6 General Strategy for Gradient methods (1) Calculate a search direction (2) Select a step length in that direction to reduce f(x) Steepest Descent.
Inexact SQP methods for equality constrained optimization Frank Edward Curtis Department of IE/MS, Northwestern University with Richard Byrd and Jorge.
Lecture 16 Economic Dispatch Professor Tom Overbye Department of Electrical and Computer Engineering ECE 476 POWER SYSTEM ANALYSIS.
Mathematical Analysis of MaxEnt for Mixed Pixel Decomposition
1 Slides by Yong Liu 1, Deep Medhi 2, and Michał Pióro 3 1 Polytechnic University, New York, USA 2 University of Missouri-Kansas City, USA 3 Warsaw University.
OR Relation between (P) & (D). OR optimal solution InfeasibleUnbounded Optimal solution OXX Infeasible X( O )O Unbounded XOX (D) (P)
Part 3. Linear Programming 3.2 Algorithm. General Formulation Convex function Convex region.
Chapter 2-OPTIMIZATION G.Anuradha. Contents Derivative-based Optimization –Descent Methods –The Method of Steepest Descent –Classical Newton’s Method.
1 Chapter 20 Model Predictive Control Model Predictive Control (MPC) – regulatory controls that use an explicit dynamic model of the response of process.
Nonlinear Programming In this handout Gradient Search for Multivariable Unconstrained Optimization KKT Conditions for Optimality of Constrained Optimization.
Economics 2301 Lecture 37 Constrained Optimization.
Linear Programming Chapter 9. Interior Point Methods  Three major variants  Affine scaling algorithm - easy concept, good performance  Potential.
Linear Programming Interior-Point Methods D. Eiland.
Linear Programming Chapter 1 Introduction.
Ch. Eick: Num. Optimization with GAs Numerical Optimization General Framework: objective function f(x 1,...,x n ) to be minimized or maximized constraints:
1 Introduction Optimization: Produce best quality of life with the available resources Engineering design optimization: Find the best system that satisfies.
Lecture 20 Review of ISM 206 Optimization Theory and Applications.
Part 4 Nonlinear Programming 4.3 Successive Linear Programming.
Optimal Control.
Chapter 20 Model Predictive Control (MPC) from Seborg, Edgar, Mellichamp, Process Dynamics and Control, 2nd Ed 1 rev. 2.1 of May 4, 2016.
Announcements Please read Chapter 7 HW 6 is due today
Bounded Nonlinear Optimization to Fit a Model of Acoustic Foams
120th AES 6840 : Analysis and Optimal Design of Miniature Loudspeakers Mingsain R. Bai and Rong-Liang Chen Department of Mechanical Engineering, National.
Part 4 Nonlinear Programming
Solver & Optimization Problems
Computational Optimization
Optimization of Process Flowsheets
CS5321 Numerical Optimization
CS5321 Numerical Optimization
Part 4 Nonlinear Programming
2.1 Solving Linear Inequalities
Chapter 2. Simplex method
Constraints.
Presentation transcript:

1 Chapter 8 Nonlinear Programming with Constraints

2 Chapter 8

3

4 Methods for Solving NLP Problems

5 Chapter 8 ; see Fig. E 8.1a

6 Chapter 8

7

8

9

10 Chapter 8

11 Chapter 8

12 Chapter 8 Note that there are n + m equations in the n + m unknowns x and λ

13 Chapter 8

14 Chapter 8

15 Chapter 8

16 Chapter 8

17 By the Lagrange multiplier method. Solution: The Lagrange function is The necessary conditions for a stationary point are Chapter 8

18 Chapter 8

19 Chapter 8

20 Chapter 8

21 Chapter 8 Penalty functions for handling equality constraints

22 Chapter 8

23 Chapter 8 for handling inequality constraints Note g must be >0 ; r 0

24 Chapter 8 The logarithmic barrier function formulation for m constraints is

25 Chapter 8

26 Chapter 8

27 Chapter 8

28 Chapter 8

29 Chapter 8 Use x c = 2 y c = 2 for linearization (step bounds)

30 Chapter 8

31 Chapter 8

32 Chapter 8

33 Chapter 8 Quadratic Programming (QP)

34 Chapter QUADRATIC PROGRAMMING

35 Use of Quadratic Programming to Design Multivariable Controllers (Model Predictive Control) Targets (set points) selected by real-time optimization software based on current operating and economic conditions Minimize square of deviations between predicted future outputs and specific reference trajectory to new targets using QP Framework handles multiple input, multiple output (MIMO) control problems with constraints on manipulated and controlled variables. Dynamics obtained from transfer function model. Chapter 8

36 Successive Quadratic Programming Considered by some to be the best general nonlinear programming algorithm Repetitively approximates nonlinear objective function with quadratic function and nonlinear constraints with linear constraints Uses line search rather than QP step for each iteration Inequality constrained Quadratic Programming (IQP) keeps all inequality constraints Equality constrained Quadratic Programming (EQP) only keeps equality constraints by utilizing and active set strategy SQP is an Infeasible Path method Chapter 8

37 Chapter 8

38 Chapter 8 solve for

39 Chapter 8 Generalized Reduced Gradient (GRG)

40 Chapter 8

41 Chapter 8

42 Chapter 8

43 Chapter 8

44 Chapter 8

45 Chapter 8

46 Chapter 8

47 Chapter 8

48 Chapter 8

49 Chapter 8

50 Chapter 8

51 sequential simplex conjugate gradient Newton’s method Quasi-Newton Chapter 8

52 Chapter 8

53 Chapter 8

54 Chapter 8

55 Chapter 8

56 Chapter 8

57 Chapter 8

58 Chapter 8

59 Chapter 8

60 Chapter 8

61 Chapter 8

62 Chapter 1 we have to supplement blast furnace gas with fuel oil, but we want to minimize the purchase of fuel oil. Chapter 8

63 Chapter 1 define: X 1 = amount of fuel oil used in generator 1 X 2 = amount of fuel oil used in generator 2 X 3 = amount of BFG used in generator 1 X 4 = amount of BFG used in generator 2 P 1 = mw output of generator 1 P 2 = mw output of generator 2 range of operation of generator 1 and generator 2 18 ≤ P 1 ≤ ≤ P 2 ≤ 25 Fuel effects in the generators are additive (can operate on either BFG or fuel oil) Chapter 8

64 Chapter 1 10 units of BFG are available (on the average): 1 unit BFG = Btu equivalent of 1 ton/hr. fuel oil. We need 50 mw power at all times. Experimental data needed? Chapter 8

65 Chapter 1 Mathematical Statement a.operating ranges18 ≤ P 1 ≤ 30 & requirements14 ≤ P 2 ≤ 25 P 1 + P 2 = 50 b. availability of x 3 + x 4 blast furnace gas c. operatingP 11 (x 1 )fuel oil characteristicsP 12 (x 3 )BFG P 21 (x 2 )fuel oil P 22 (x 4 )BFG gen 1 gen 2 Chapter 8

66 Chapter 1 fcn of burners, heat transfer characteristics (convex functions) Chapter 8

67 Chapter 1 Solution NLP4 ineq. const. piece-wise LP6 eq. const. No fuel oil is used in generator 1. In generator 2, fuel oil provides 58% of the power (rest is BFG). heat transfer characteristics may change, or BFG may vary w.r.t. time (on-line solution) Chapter 8