Summary of complementary slackness: 1. If x i ≠ 0, i= 1, 2, …, n the ith dual equation is tight. 2. If equation i of the primal is not tight, y i =0. 1.

Slides:



Advertisements
Similar presentations
Solving Linear Programming Problems
Advertisements

Tuesday, March 5 Duality – The art of obtaining bounds – weak and strong duality Handouts: Lecture Notes.
1. Set up the phase 1 dictionary for this problem and make the first pivot: Maximize X 1 + X X 3 + X 4 subject to -X 1 + X X 4 ≤ -3 -X 1 +
1 LP Duality Lecture 13: Feb Min-Max Theorems In bipartite graph, Maximum matching = Minimum Vertex Cover In every graph, Maximum Flow = Minimum.
Geometry and Theory of LP Standard (Inequality) Primal Problem: Dual Problem:
In a previous lecture, this dictionary resulted after the first phase 1 pivot: X0 = X1 - 1 X2 + 1 X3 X4 = X1 + 3 X2 + 1 X
IEOR 4004 Midterm review (Part II) March 12, 2014.
Standard Minimization Problems with the Dual
Gomory’s cutting plane algorithm for integer programming Prepared by Shin-ichi Tanigawa.
Chapter 6 Linear Programming: The Simplex Method
Copyright (c) 2003 Brooks/Cole, a division of Thomson Learning, Inc
4.1 Slack Variables and the Simplex Method Maximizing Objective Functions Maximize the objective function subject to: What would this look like?
ISM 206 Lecture 4 Duality and Sensitivity Analysis.
Duality Dual problem Duality Theorem Complementary Slackness
Finite Mathematics & Its Applications, 10/e by Goldstein/Schneider/SiegelCopyright © 2010 Pearson Education, Inc. 1 of 99 Chapter 4 The Simplex Method.
Computational Methods for Management and Economics Carla Gomes
7(3) Shadow Prices   Economic interpretation?
7(2) THE DUAL THEOREMS Primal ProblemDual Problem b is not assumed to be non-negative.
ISM 206 Lecture 4 Duality and Sensitivity Analysis.
Chapter 4 The Simplex Method
Table of Contents Solving Linear Systems of Equations - Substitution Method Recall that to solve the linear system of equations in two variables... we.
Use complementary slackness to check the solution: ( 20/3, 0, 16/3, 0) Maximize 9 x 1 -3 x x 3 -7 x 4 subject to 2 x x x x 4 ≤
Linear Programming - Standard Form
Duality Theory 對偶理論.
Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display. 1 Chapter 15.
The Simplex Method. Standard Linear Programming Problem Standard Maximization Problem 1. All variables are nonnegative. 2. All the constraints (the conditions)
Introduction to Operations Research
Goal: Solve a system of linear equations in two variables by the linear combination method.
Solving Linear Systems of Equations - Substitution Method Recall that to solve the linear system of equations in two variables... we need to find the value.
4  The Simplex Method: Standard Maximization Problems  The Simplex Method: Standard Minimization Problems  The Simplex Method: Nonstandard Problems.
Advanced Operations Research Models Instructor: Dr. A. Seifi Teaching Assistant: Golbarg Kazemi 1.
1 Bob and Sue solved this by hand: Maximize x x 2 subject to 1 x x 2 ≤ x x 2 ≤ 4 x 1, x 2 ≥ 0 and their last dictionary was: X1.
1 THE REVISED SIMPLEX METHOD CONTENTS Linear Program in the Matrix Notation Basic Feasible Solution in Matrix Notation Revised Simplex Method in Matrix.
Notes – 2/13 Addition Method of solving a System of Equations Also called the Elimination Method.
Do Now (3x + y) – (2x + y) 4(2x + 3y) – (8x – y)
OR Chapter 7. The Revised Simplex Method  Recall Theorem 3.1, same basis  same dictionary Entire dictionary can be constructed as long as we.
7.3 Solving Systems of Equations by Elimination Using Multiplication Solve by Elimination Example Problems Practice Problems.
OR Relation between (P) & (D). OR optimal solution InfeasibleUnbounded Optimal solution OXX Infeasible X( O )O Unbounded XOX (D) (P)
Differential Equations Linear Equations with Variable Coefficients.
Nonlinear Programming In this handout Gradient Search for Multivariable Unconstrained Optimization KKT Conditions for Optimality of Constrained Optimization.
Warm-up. Systems of Equations: Substitution Solving by Substitution 1)Solve one of the equations for a variable. 2)Substitute the expression from step.
Copyright © 2006 Brooks/Cole, a division of Thomson Learning, Inc. Linear Programming: An Algebraic Approach 4 The Simplex Method with Standard Maximization.
Sullivan Algebra and Trigonometry: Section 12.9 Objectives of this Section Set Up a Linear Programming Problem Solve a Linear Programming Problem.
Use duality theory to check if the solution implied by the dictionary is correct. Maximize x x x 3 subject to 1 x x x 3 ≤ 5 1 x.
WARM-UP. SYSTEMS OF EQUATIONS: ELIMINATION 1)Rewrite each equation in standard form, eliminating fraction coefficients. 2)If necessary, multiply one.
Chap 10. Sensitivity Analysis
EMGT 6412/MATH 6665 Mathematical Programming Spring 2016
3-2: Solving Systems of Equations using Substitution
Chap 9. General LP problems: Duality and Infeasibility
The Simplex Method: Standard Minimization Problems
Lesson 7-4 part 3 Solving Systems by Elimination
3-2: Solving Systems of Equations using Substitution
Solving Systems of Equations using Substitution
Do Now 1) t + 3 = – 2 2) 18 – 4v = 42.
ENGM 631 Optimization.
3-2: Solving Systems of Equations using Substitution
Chapter 5. The Duality Theorem
7.3 Notes.
Solving Equations with Variables on Both Sides
Solving Equations with Variables on Both Sides
3-2: Solving Systems of Equations using Substitution
Solving Systems of Equations by Elimination Part 2
3-2: Solving Systems of Equations using Substitution
3-2: Solving Systems of Equations using Substitution
3-2: Solving Systems of Equations using Substitution
3-2: Solving Systems of Equations using Substitution
Practical Issues Finding an initial feasible solution Cycling
The Substitution Method
Constraints.
Presentation transcript:

Summary of complementary slackness: 1. If x i ≠ 0, i= 1, 2, …, n the ith dual equation is tight. 2. If equation i of the primal is not tight, y i =0. 1

Complementary Slackness Theorem (5.2): x' = feasible primal solution y' = feasible dual solution Necessary and sufficient conditions for simultaneous optimality of x' and y' are 1. For all i=1, 2, …, m, either (a i1 * x 1 ' + a i2 *x 2 ' + … + a in *x n ')= b i or y i ' = 0 (or both). 2. For all i=1, 2,..., n, either (a 1j * y 1 ' + a 2j *y 2 ' a mj *y m ') = c i or x i ' = 0 (or both). 2

Recipe for Using this Theorem Given: x' which is a feasible solution. Question: Is x' an optimal solution? Procedure: 1. First consider each x j ' (j=1, 2,..., n) such that x j ' is NOT 0. Write down the equation of the dual that corresponds to the coefficients of x j in the primal: (a 1j y 1 + a 2j y a mj y m ) = c j 2. Next consider each equation i of the primal problem (i=1, 2, 3,..., m). If the ith equation is NOT tight (there is some slack), write down y i = 0. 3

3. Solve these equations that you get for y. If there is a unique solution continue. If not, abort. 4. Test y to see if it is dual feasible. Yes- x' is optimal. No- x' is not optimal. When does the system of equations have a unique solution? Theorem 5.4 in text: when x' is a nondegenerate basic feasible solution. Nondegenerate: no basic variables have value 0. 4

The problem: Maximize 5 X X X 3 subject to 2 X X X 3 ≤ 5 4 X X X 3 ≤ 11 3 X X X 3 ≤ 8 X 1, X 2, X 3 ≥ 0 5

The second last dictionary: u= (2.5, 0, 0) X1 = X X X4 X5 = X2 + 0 X3 + 2 X4 X6 = X X X z= X X X4 Check this using complementary slackness. 6

u=(2.5, 0, 0) Maximize 5 X X X 3 Constraints: 2 X X X 3 ≤ 5 4 X X X 3 ≤ 11 3 X X X 3 ≤ 8 1. First consider each X j ' such that X j ' is NOT 0. Write down the equation of the dual that corresponds to the coefficients of X j in the primal: X 1 ≠ 0: 2 Y Y Y 3 = 5 2. Next consider each equation i of the primal problem If the ith equation is NOT tight (there is some slack), write down Yi= 0. 2(2.5) + 3(0) + 1(0) = 5 <= 5 TIGHT 4(2.5) + 1(0) + 2(0) = 10 <= 11 Y2=0 3(2.5) + 4(0) + 2(0) = 7.5 <= 8 Y3=0 7

2. Next consider each equation i of the primal problem If the ith equation is NOT tight (there is some slack), write down Y i = 0. 2 X X X 3 ≤ 5 4 X X X 3 ≤ 11 3 X X X 3 ≤ 8 2(2.5) + 3(0) +1(0)= 5 = 5 TIGHT 4(2.5) + 1(0) +2(0)= 10 < 11 Y 2 =0 3(2.5) + 4(0) +2(0)=7.5 < 8 Y 3 =0 8

Solve for y: 2 Y Y Y 3 = 5 Y 2 = 0 Y 3 = 0 y 1 = 5/2, y 2 =0, y 3 =0. 9

The problem: Maximize 5 X X X 3 subject to 2 X X X 3 ≤ 5 4 X X X 3 ≤ 11 3 X X X 3 ≤ 8 X 1, X 2, X 3 ≥ 0 What is the dual? Check y1= 5/2, y2=0, y3=0 for dual feasibility. 10

The last dictionary: v= (2, 0, 1) X1 = X2 - 2 X4 + 1 X6 X5 = X2 + 2 X4 + 0 X6 X3 = X2 + 3 X4 - 2 X z = X2 - 1 X4 - 1 X6 Check this using complementary slackness. 11

1. Write down dual equations for non-zero X i ’s: v= (2, 0, 1) Maximize 5 X X X 3 Constraints: 2 X X X 3 ≤ 5 4 X X X 3 ≤ 11 3 X X X 3 ≤ 8 X 1 ≠ 0: 2 Y Y Y 3 = 5 X 3 ≠ 0: 1 Y Y Y 3 = 1 12

2. Next consider each equation i of the primal problem If the ith equation is NOT tight (there is some slack), write down Y i = 0. v= (2, 0, 1) Constraints: 2 X X X 3 ≤ 5 4 X X X 3 ≤ 11 3 X X X 3 ≤ 8 2(2) + 3(0) + 1(1)= 5 = 5 TIGHT 4(2) + 1(0) + 2(1)= 10< 11 Y 2 =0 3(2) + 4(0) + 2(1)= 8= 8 TIGHT 13

3. Solve for Y. X 1 ≠ 0: 2 Y Y Y 3 = 5 X 3 ≠ 0: 1 Y Y Y 3 = 3 Y 2 = 0 Solution: (1, 0, 1) Test y for dual feasibility. 14

We have already argued that these conditions are necessary for optimality. Why are they sufficient? 15

Complementary Slackness Theorem (5.2): x' = feasible primal solution y' = feasible dual solution Necessary and sufficient conditions for simultaneous optimality of x' and y' are 1. For all i=1, 2, …, m, either (a i1 * x 1 ' + a i2 *x 2 ' + … + a in *x n ')= b i or y i ' = 0 (or both). 2. For all i=1, 2,..., n, either (a 1j * y 1 ' + a 2j *y 2 ' a mj *y m ') = c i or x i ' = 0 (or both). 16

Earlier we showed that for feasible primal and dual solutions: c 1 x 1 + c 2 x c n x n ≤ S = (a 11 y 1 + a 21 y a m1 y m )x 1 + (a 12 y 1 + a 22 y a m2 y m )x (a 1n y 1 + a 2n y a mn y m ) x n = (a 11 x 1 + a 12 x a 1n x n )y 1 + (a 21 x 1 + a 22 x a 2n x n )y (a m1 x 1 + a m2 x a mn x n ) y m ≤ b 1 y 1 + b 2 y b m y m 17

In a final dictionary: m basic variables. Of these, assume b of them are from x 1, …,x n and the remaining m-b are slacks. If the solution is not degenerate then we get b equations from having the non-zero values from x 1, …,x n and m-b equations that are not tight. This gives a square (b by b) system to solve. 18

Complementary Slackness Theorem (5.2): x' = feasible primal solution y' = feasible dual solution Necessary and sufficient conditions for simultaneous optimality of x' and y' are 1. For all i=1, 2, …, m, either (a i1 * x 1 ' + a i2 *x 2 ' + … + a in *x n ')= b i or y i ' = 0 (or both). 2. For all i=1, 2,..., n, either (a 1j * y 1 ' + a 2j *y 2 ' a mj *y m ') = c i or x i ' = 0 (or both). Problem is the “or both” parts. 19