Duality Dual problem Duality Theorem Complementary Slackness

Slides:



Advertisements
Similar presentations
Summary of complementary slackness: 1. If x i ≠ 0, i= 1, 2, …, n the ith dual equation is tight. 2. If equation i of the primal is not tight, y i =0. 1.
Advertisements

1 LP Duality Lecture 13: Feb Min-Max Theorems In bipartite graph, Maximum matching = Minimum Vertex Cover In every graph, Maximum Flow = Minimum.
Geometry and Theory of LP Standard (Inequality) Primal Problem: Dual Problem:
In a previous lecture, this dictionary resulted after the first phase 1 pivot: X0 = X1 - 1 X2 + 1 X3 X4 = X1 + 3 X2 + 1 X
IEOR 4004 Midterm review (Part II) March 12, 2014.
ECE Longest Path dual 1 ECE 665 Spring 2005 ECE 665 Spring 2005 Computer Algorithms with Applications to VLSI CAD Linear Programming Duality – Longest.
EMGT 501 HW #1 Solutions Chapter 2 - SELF TEST 18
Understanding optimum solution
Copyright (c) 2003 Brooks/Cole, a division of Thomson Learning, Inc
OR Simplex method (algebraic interpretation) Add slack variables( 여유변수 ) to each constraint to convert them to equations. (We may refer it as.
SOLVING LINEAR PROGRAMS USING EXCEL Dr. Ron Lembke.
Separating Hyperplanes
Linear programming Thomas S. Ferguson University of California at Los Angeles Compressive Sensing Tutorial PART 3 Svetlana Avramov-Zamurovic January 29,
The Simplex Method: Standard Maximization Problems
ISM 206 Lecture 4 Duality and Sensitivity Analysis.
EMGT 501 HW # (b) (c) 6.1-4, Due Day: Sep. 21.
Finite Mathematics & Its Applications, 10/e by Goldstein/Schneider/SiegelCopyright © 2010 Pearson Education, Inc. 1 of 99 Chapter 4 The Simplex Method.
7(3) Shadow Prices   Economic interpretation?
7(2) THE DUAL THEOREMS Primal ProblemDual Problem b is not assumed to be non-negative.
ISM 206 Lecture 4 Duality and Sensitivity Analysis.
Problem Set # 4 Maximize f(x) = 3x1 + 2 x2 subject to x1 ≤ 4 x1 + 3 x2 ≤ 15 2x1 + x2 ≤ 10 Problem 1 Solve these problems using the simplex tableau. Maximize.
5.6 Maximization and Minimization with Mixed Problem Constraints
Chapter 4 The Simplex Method
Use complementary slackness to check the solution: ( 20/3, 0, 16/3, 0) Maximize 9 x 1 -3 x x 3 -7 x 4 subject to 2 x x x x 4 ≤
Linear Programming - Standard Form
Duality Theory 對偶理論.
Simplex method (algebraic interpretation)
1 Chapter 7 Linear Programming. 2 Linear Programming (LP) Problems Both objective function and constraints are linear. Solutions are highly structured.
The Simplex Method. Standard Linear Programming Problem Standard Maximization Problem 1. All variables are nonnegative. 2. All the constraints (the conditions)
Introduction to Operations Research
Duality Theory  Every LP problem (called the ‘Primal’) has associated with another problem called the ‘Dual’.  The ‘Dual’ problem is an LP defined directly.
Duality Theory.
Advanced Operations Research Models Instructor: Dr. A. Seifi Teaching Assistant: Golbarg Kazemi 1.
 Minimization Problem  First Approach  Introduce the basis variable  To solve minimization problem we simple reverse the rule that is we select the.
1 Bob and Sue solved this by hand: Maximize x x 2 subject to 1 x x 2 ≤ x x 2 ≤ 4 x 1, x 2 ≥ 0 and their last dictionary was: X1.
1 1 Slide © 2005 Thomson/South-Western Simplex-Based Sensitivity Analysis and Duality n Sensitivity Analysis with the Simplex Tableau n Duality.
Part 3 Linear Programming 3.3 Theoretical Analysis.
C&O 355 Mathematical Programming Fall 2010 Lecture 5 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A A.
1 THE REVISED SIMPLEX METHOD CONTENTS Linear Program in the Matrix Notation Basic Feasible Solution in Matrix Notation Revised Simplex Method in Matrix.
OR Chapter 8. General LP Problems Converting other forms to general LP problem : min c’x  - max (-c)’x   = by adding a nonnegative slack variable.
OR Simplex method (algebraic interpretation) Add slack variables( 여유변수 ) to each constraint to convert them to equations. (We may refer it as.
OR Chapter 7. The Revised Simplex Method  Recall Theorem 3.1, same basis  same dictionary Entire dictionary can be constructed as long as we.
LINEAR PROGRAMMING 3.4 Learning goals represent constraints by equations or inequalities, and by systems of equations and/or inequalities, and interpret.
Linear Programming Chapter 9. Interior Point Methods  Three major variants  Affine scaling algorithm - easy concept, good performance  Potential.
Copyright © 2006 Brooks/Cole, a division of Thomson Learning, Inc. Linear Programming: An Algebraic Approach 4 The Simplex Method with Standard Maximization.
OR II GSLM
Use duality theory to check if the solution implied by the dictionary is correct. Maximize x x x 3 subject to 1 x x x 3 ≤ 5 1 x.
Part 3 Linear Programming 3.3 Theoretical Analysis.
The Duality Theorem Primal P: Maximize
Chap 10. Sensitivity Analysis
The minimum cost flow problem
EMGT 6412/MATH 6665 Mathematical Programming Spring 2016
Chapter 5 Simplex-Based Sensitivity Analysis and Duality
Solving Equations by Factoring and Problem Solving
Chap 9. General LP problems: Duality and Infeasibility
The Simplex Method: Standard Minimization Problems
Chapter 5. Sensitivity Analysis
Duality Theory and Sensitivity Analysis
St. Edward’s University
ENGM 631 Optimization.
Chapter 4. Duality Theory
ENGM 435/535 Optimization Adapting to Non-standard forms.
Lecture 4 Part I Mohamed A. M. A..
Chapter 5. The Duality Theorem
Lecture 20 Linear Program Duality
Flow Feasibility Problems
Chapter-III Duality in LPP
Simplex Tableau Method
Linear Constrained Optimization
Presentation transcript:

Duality Dual problem Duality Theorem Complementary Slackness Economic interpretation of dual variables

Primal Problem max +4 x1 +1 x2 +5 x3 +3 x4 s.t. +1 x1 -1 x2 -1 x3 +3 ≤ 1 +5 x1 +1 x2 +3 x3 +8 x4 ≤ 55 -1 x1 +2 x2 +3 x3 -5 x4 ≤ 3

Vector View max +4 x1 +1 x2 +5 x3 +3 x4 s.t. +1 -1 -1 +3 1 +5 x1 +1 x2 +8 x4 ≤ 55 -1 +2 +3 -5 3

Linearly combine rows max +4 x1 +1 x2 +5 x3 +3 x4 s.t. y1 +1 -1 -1 +3 +8 x4 ≤ 55 y3 -1 +2 +3 -5 3

Move y into vectors max +4 x1 +1 x2 +5 x3 +3 x4 s.t. +1 y1 -1 y1 -1 y1 +8 y2 x4 ≤ 55 y2 -1 y3 +2 y3 +3 y3 -5 y3 3 y3

Column Constraints max +4 +1 +5 +3 ≥ ≥ ≥ ≥ s.t. +1 y1 -1 y1 -1 y1 +3 +8 y2 ≤ 55 y2 -1 y3 +2 y3 +3 y3 -5 y3 3 y3

Dual Problem min +1 y1 +55 y2 +5 y3 s.t. +1 y1 +5 y2 -1 y3 ≥ 4 -1 y1 +2 y3 ≥ 1 -1 y1 +3 y2 +3 y3 ≥ 5 +3 y1 +8 y2 -5 y3 ≥ 3

Observations The objective value of any feasible primal solution is less than the objective value of any feasible dual solution Duality Theorem If both problems have an optimal solution, they are equal in value Optimal dual solution can be read off of final dictionary Dual solution serves as a certificate of optimality Quick verification of optimality of primal solution

Example from Text Maximize 4x1 + x2 + 5x3 + 3x4 s.t. x1 - x2 - x3 + 3x4 ≤ 1 5x1 + x2 + 3x3 + 8x4 ≤ 55 -x1 + 2x2 + 3x3 - 5x4 ≤ 3 Final Dictionary x2 = 14 - 2x1 - 4x3 - 5x5 + 3x7 x4 = 5 - x1 - x3 - 2x5 - x7 x6 = 1 + 5x1 + 9x3 +21x5 +11x7 z = 29 - x1 - 2x3 -11x5 - 6x7

Reading optimal solution to dual problem Final Dictionary x2 = 14 - 2x1 - 4x3 - 5x5 + 3x7 x4 = 5 - x1 - x3 - 2x5 - x7 x6 = 1 + 5x1 + 9x3 +21x5 +11x7 z = 29 - x1 - 2x3 -11x5 - 0x6 -6x7 Dual objective: min y1 + 55y2 + 3y3 Linking slack variables with dual variables x5 associated with y1 → y1 = 11 x6 associated with y2 → y2 = 0 x7 associated with y3 → y3 = 6

Linking back to original problem z = 29 - 1x1 - 2x3 -11x5 - 0x6 -6x7 Dual objective: min y1 + 55y2 + 3y3 y1 = 11 y2 = 0 y3 = 6 Original Primal Problem Maximize 4x1 + x2 + 5x3 + 3x4 s.t. x1 - x2 - x3 + 3x4 ≤ 1 5x1 + x2 + 3x3 + 8x4 ≤ 55 -x1 + 2x2 + 3x3 - 5x4 ≤ 3

Complementary Slackness 1 max +4 x1 +1 x2 +5 x3 +3 x4 s.t. +1 y1 -1 y1 -1 y1 +3 y1 1 y1 +5 y2 x1 +1 y2 x2 +3 y2 x3 +8 y2 x4 ≤ 55 y2 -1 y3 +2 y3 +3 y3 -5 y3 3 y3 +1y1 + 5y2 – 1y3 = 4 OR x1 = 0

Complementary Slackness 2 max +4 x1 +1 x2 +5 x3 +3 x4 s.t. +1 y1 -1 y1 -1 y1 +3 y1 1 y1 +5 y2 x1 +1 y2 x2 +3 y2 x3 +8 y2 x4 ≤ 55 y2 -1 y3 +2 y3 +3 y3 -5 y3 3 y3 +1x1 - x2 – x3 +3x4 = 1 OR y1 = 0

Checking Optimality Without Certificate Given candidate primal solution x Write down equation in dual variables y Use dual constraints at equality corresponding to components of x ≠ 0 Add in equation yj = 0 if primal constraint i is not tight If solution is a nondegenerate basic solution, there is a unique solution y

Example from Text Maximize 4x1 + x2 + 5x3 + 3x4 s.t. x1 - x2 - x3 + 3x4 ≤ 1 5x1 + x2 + 3x3 + 8x4 ≤ 55 -x1 + 2x2 + 3x3 - 5x4 ≤ 3 Candidate solution x1 = 0, x2 = 14, x3 = 0, x4 = 5 System of constraints 1 = -y1 + y2 + 2y3 3 = 3y1 + 8y2 - 5y3 0 = y2

Economic interpretation of dual variables Values of optimal dual variables (yi) give the marginal value of small increases or decreases of the given resource (bi) Requires optimal basic solution to be a nondegenerate basic optimal solution See worksheet for examples