7(2).1 7.4 THE DUAL THEOREMS Primal ProblemDual Problem b is not assumed to be non-negative.

Slides:



Advertisements
Similar presentations
Tuesday, March 5 Duality – The art of obtaining bounds – weak and strong duality Handouts: Lecture Notes.
Advertisements

Duality for linear programming. Illustration of the notion Consider an enterprise producing r items: f k = demand for the item k =1,…, r using s components:
C&O 355 Lecture 8 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A.
Summary of complementary slackness: 1. If x i ≠ 0, i= 1, 2, …, n the ith dual equation is tight. 2. If equation i of the primal is not tight, y i =0. 1.
1 LP Duality Lecture 13: Feb Min-Max Theorems In bipartite graph, Maximum matching = Minimum Vertex Cover In every graph, Maximum Flow = Minimum.
Geometry and Theory of LP Standard (Inequality) Primal Problem: Dual Problem:
In a previous lecture, this dictionary resulted after the first phase 1 pivot: X0 = X1 - 1 X2 + 1 X3 X4 = X1 + 3 X2 + 1 X
IEOR 4004 Midterm review (Part II) March 12, 2014.
EMGT 501 HW #1 Solutions Chapter 2 - SELF TEST 18
Introduction to Algorithms
Copyright (c) 2003 Brooks/Cole, a division of Thomson Learning, Inc
The Simplex Method and Linear Programming Duality Ashish Goel Department of Management Science and Engineering Stanford University Stanford, CA 94305,
Chapter 6 Linear Programming: The Simplex Method Section 3 The Dual Problem: Minimization with Problem Constraints of the Form ≥
The Most Important Concept in Optimization (minimization)  A point is said to be an optimal solution of a unconstrained minimization if there exists no.
Chapter 7 LINEAR PROGRAMMING.
CSCI 3160 Design and Analysis of Algorithms Tutorial 6 Fei Chen.
Q 2-31 Min 3A + 4B s.t. 1A + 3B ≧ 6 B = - 1/3A + 2 1A + 1B ≧ 4
Linear Programming Special Cases Alternate Optimal Solutions No Feasible Solution Unbounded Solutions.
Duality Dual problem Duality Theorem Complementary Slackness
Finite Mathematics & Its Applications, 10/e by Goldstein/Schneider/SiegelCopyright © 2010 Pearson Education, Inc. 1 of 99 Chapter 4 The Simplex Method.
Computational Methods for Management and Economics Carla Gomes
7(3) Shadow Prices   Economic interpretation?
ISM 206 Lecture 4 Duality and Sensitivity Analysis.
Problem Set # 4 Maximize f(x) = 3x1 + 2 x2 subject to x1 ≤ 4 x1 + 3 x2 ≤ 15 2x1 + x2 ≤ 10 Problem 1 Solve these problems using the simplex tableau. Maximize.
Chapter 4 The Simplex Method
1 Linear Programming Supplements (Optional). 2 Standard Form LP (a.k.a. First Primal Form) Strictly ≤ All x j 's are non-negative.
Duality Theory 對偶理論.
Duality Theory LI Xiaolei.
Pareto Linear Programming The Problem: P-opt Cx s.t Ax ≤ b x ≥ 0 where C is a kxn matrix so that Cx = (c (1) x, c (2) x,..., c (k) x) where c.
The Simplex Method. Standard Linear Programming Problem Standard Maximization Problem 1. All variables are nonnegative. 2. All the constraints (the conditions)
Introduction to Operations Research
Approximation Algorithms Department of Mathematics and Computer Science Drexel University.
Department Of Industrial Engineering Duality And Sensitivity Analysis presented by: Taha Ben Omar Supervisor: Prof. Dr. Sahand Daneshvar.
OR Perturbation Method (tableau form) (after two iterations, optimal solution obtained) (0+2  1 ) (0+2  2 ) (1+  3 )
Duality Theory.
Linear Programming Revised Simplex Method, Duality of LP problems and Sensitivity analysis D Nagesh Kumar, IISc Optimization Methods: M3L5.
4  The Simplex Method: Standard Maximization Problems  The Simplex Method: Standard Minimization Problems  The Simplex Method: Nonstandard Problems.
Chapter 6 Linear Programming: The Simplex Method Section 3 The Dual Problem: Minimization with Problem Constraints of the Form ≥
Advanced Operations Research Models Instructor: Dr. A. Seifi Teaching Assistant: Golbarg Kazemi 1.
1 Bob and Sue solved this by hand: Maximize x x 2 subject to 1 x x 2 ≤ x x 2 ≤ 4 x 1, x 2 ≥ 0 and their last dictionary was: X1.
EE/Econ 458 Duality J. McCalley.
Linear Program Set Cover. Given a universe U of n elements, a collection of subsets of U, S = {S 1,…, S k }, and a cost function c: S → Q +. Find a minimum.
C&O 355 Mathematical Programming Fall 2010 Lecture 5 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A A.
1 THE REVISED SIMPLEX METHOD CONTENTS Linear Program in the Matrix Notation Basic Feasible Solution in Matrix Notation Revised Simplex Method in Matrix.
Hon Wai Leong, NUS (CS6234, Spring 2009) Page 1 Copyright © 2009 by Leong Hon Wai CS6234: Lecture 4  Linear Programming  LP and Simplex Algorithm [PS82]-Ch2.
OR Chapter 8. General LP Problems Converting other forms to general LP problem : min c’x  - max (-c)’x   = by adding a nonnegative slack variable.
CPSC 536N Sparse Approximations Winter 2013 Lecture 1 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AAAAAAAAAA.
OR Chapter 7. The Revised Simplex Method  Recall Theorem 3.1, same basis  same dictionary Entire dictionary can be constructed as long as we.
OR Relation between (P) & (D). OR optimal solution InfeasibleUnbounded Optimal solution OXX Infeasible X( O )O Unbounded XOX (D) (P)
Linear Programming Chapter 9. Interior Point Methods  Three major variants  Affine scaling algorithm - easy concept, good performance  Potential.
Copyright © 2006 Brooks/Cole, a division of Thomson Learning, Inc. Linear Programming: An Algebraic Approach 4 The Simplex Method with Standard Maximization.
2.5 The Fundamental Theorem of Game Theory For any 2-person zero-sum game there exists a pair (x*,y*) in S  T such that min {x*V. j : j=1,...,n} =
Approximation Algorithms based on linear programming.
Part 3 Linear Programming 3.3 Theoretical Analysis.
The Duality Theorem Primal P: Maximize
Linear Programming Revised Simplex Method, Duality of LP problems and Sensitivity analysis D Nagesh Kumar, IISc Optimization Methods: M3L5.
Chap 10. Sensitivity Analysis
EMGT 6412/MATH 6665 Mathematical Programming Spring 2016
Duality for linear programming.
Sindhuja K, Annapoorani G, Pramela Devi S Department: CSE
Chap 9. General LP problems: Duality and Infeasibility
The Simplex Method: Standard Minimization Problems
Chapter 5. Sensitivity Analysis
ENGM 631 Optimization.
Chapter 4. Duality Theory
Lecture 4 Part I Mohamed A. M. A..
Chapter 5. The Duality Theorem
Chapter-III Duality in LPP
DUALITY THEORY Reference: Chapter 6 in Bazaraa, Jarvis and Sherali.
Presentation transcript:

7(2) THE DUAL THEOREMS Primal ProblemDual Problem b is not assumed to be non-negative

7(2) Weak Duality Theorem If x is a feasible solution to the primal problem from (7.13) and y is a feasible solution to the dual problem, then cx  by. If x is a feasible solution to the primal problem from (7.13) and y is a feasible solution to the dual problem, then cx  by. : Proof: If x is a feasible solution to the Primal Problem, then we must have: Ax  b Ax  b So, if y is a feasible solution to the Dual Problem, we must have (why?) yAx  yb yAx  yb

7(2).3 Similarly, if y is feasible for the Dual, then Similarly, if y is feasible for the Dual, then yA ≥ c yA ≥ c and therefore (why?) for any feasible solution, x, of the Primal Problem we have yAx ≥ cx yAx ≥ cx It follows then that cx  by. cx  by.

7(2).4 This result implies that the optimal objective function values for the primal and dual systems are bounded above and below respectively by the other problem. This result implies that the optimal objective function values for the primal and dual systems are bounded above and below respectively by the other problem. What are the implications for the solutions? What are the implications for the optimal solutions? We shall deal with this question shortly. We shall deal with this question shortly.

7(2) Lemma If a linear programming problem has an unbounded objective, then its dual problem has no feasible solution. If a linear programming problem has an unbounded objective, then its dual problem has no feasible solution. : Observation: It is possible that the primal and the dual problem are infeasible. It is possible that both the primal and the dual problem are infeasible.

7(2) Lemma Let x* be a feasible solution to the primal problem and y* a feasible solution to the dual. Then cx* = by* implies that x* is an optimal solution for the primal and y* is optimal for the dual. Let x* be a feasible solution to the primal problem and y* a feasible solution to the dual. Then cx* = by* implies that x* is an optimal solution for the primal and y* is optimal for the dual. : Proof: From the Weak Duality theorem we have From the Weak Duality theorem we have cx  by cx  by hence we also have cx  by* cx  by*

7(2).7 for any feasible solution x of the primal and any optimal solution y* of the dual. Thus, for any feasible solution x* of the primal for which cx*=by* we have (why?) cx  cx* cx  cx* for any feasible solution, x, of the primal. This implis that x* is an optimal solution for the primal.

7(2) Strong Duality Theorem If an optimal solution exists for either the primal or its dual, then an optimal solution exists for both and the corresponding optimal objective function values are equal, namely Z* = w*. If an optimal solution exists for either the primal or its dual, then an optimal solution exists for both and the corresponding optimal objective function values are equal, namely Z* = w*. : Bottom Line: Proof: Bottom Line: Let B -1* be the “optimal” value of B -1 (final tableau) and define: Let B -1* be the “optimal” value of B -1 (final tableau) and define: y*:=c B B -1* y*:=c B B -1*

7(2).9 Then show that y* is feasible for the dual and y*b = z*. Then show that y* is feasible for the dual and y*b = z*. In view of the Weak Duality Theorem, this will imply that y* is optimal for the dual. In view of the Weak Duality Theorem, this will imply that y* is optimal for the dual. Alternatively, have a look at the tableau itself.... Alternatively, have a look at the tableau itself....

7(2).10 y = c B B -1 for any simplex tableau not necessarily the final one This is implied by our beloved recipe: r = c B B -1 D - c

7(2).11 Important Observations IN ANY TABLEAU, THE CORRESPONDING TO THE PRIMAL BASIC FEASIBLE SOLUTION ARE THE IN ANY TABLEAU, THE DUAL VARIABLES CORRESPONDING TO THE PRIMAL BASIC FEASIBLE SOLUTION ARE THE REDUCED COSTS FOR THE PRIMAL SLACK VARIABLES. IN APPLYING THE SIMPLEX METHOD TO THE PRIMAL PROBLEM, WE ALSO SOLVE ITS DUAL. IN APPLYING THE SIMPLEX METHOD TO THE PRIMAL PROBLEM, WE ALSO SOLVE ITS DUAL.

7(2) Example

7(2).13