Combinatorial Interpretations of Dual Fitting and Primal Fitting Ari Freund Cesarea Rothschild Institute, University of Haifa Dror Rawitz Department of.

Slides:



Advertisements
Similar presentations
The Primal-Dual Method: Steiner Forest TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A A AA A A A AA A A.
Advertisements

Chapter 5: Linear Programming: The Simplex Method
C&O 355 Lecture 23 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A A A A A A A A.
Geometry and Theory of LP Standard (Inequality) Primal Problem: Dual Problem:
ECE Longest Path dual 1 ECE 665 Spring 2005 ECE 665 Spring 2005 Computer Algorithms with Applications to VLSI CAD Linear Programming Duality – Longest.
Introduction to Sensitivity Analysis Graphical Sensitivity Analysis
Notes 4IE 3121 Why Sensitivity Analysis So far: find an optimium solution given certain constant parameters (costs, demand, etc) How well do we know these.
Tutorial at ICCV (Barcelona, Spain, November 2011)
Introduction to Algorithms
Primal-Dual Algorithms for Connected Facility Location Chaitanya SwamyAmit Kumar Cornell University.
1 of 56 Linear Programming-Based Approximation Algorithms Shoshana Neuburger Graduate Center, CUNY May 13, 2009.
Instructor Neelima Gupta Table of Contents Lp –rounding Dual Fitting LP-Duality.
ISM 206 Lecture 4 Duality and Sensitivity Analysis.
Linear Programming and Approximation
Primal Dual Method Lecture 20: March 28 primaldual restricted primal restricted dual y z found x, succeed! Construct a better dual.
Duality Dual problem Duality Theorem Complementary Slackness
A general approximation technique for constrained forest problems Michael X. Goemans & David P. Williamson Presented by: Yonatan Elhanani & Yuval Cohen.
Approximation Algorithms
Computational Methods for Management and Economics Carla Gomes
Integer Programming Difference from linear programming –Variables x i must take on integral values, not real values Lots of interesting problems can be.
Primal-Dual Algorithms for Connected Facility Location Chaitanya SwamyAmit Kumar Cornell University.
Facility Location using Linear Programming Duality Yinyu Ye Department if Management Science and Engineering Stanford University.
ISM 206 Lecture 4 Duality and Sensitivity Analysis.
Distributed Combinatorial Optimization
A General Approach to Online Network Optimization Problems Seffi Naor Computer Science Dept. Technion Haifa, Israel Joint work: Noga Alon, Yossi Azar,
Chapter 4 The Simplex Method
Approximation Algorithms: Bristol Summer School 2008 Seffi Naor Computer Science Dept. Technion Haifa, Israel TexPoint fonts used in EMF. Read the TexPoint.
1/24 Algorithms for Generalized Caching Nikhil Bansal IBM Research Niv Buchbinder Open Univ. Israel Seffi Naor Technion.
LP-based Algorithms for Capacitated Facility Location Chaitanya Swamy Joint work with Retsef Levi and David Shmoys Cornell University.
V. V. Vazirani. Approximation Algorithms Chapters 3 & 22
Primal-Dual Meets Local Search: Approximating MST’s with Non-uniform Degree Bounds Author: Jochen Könemann R. Ravi From CMU CS 3150 Presentation by Dan.
Chapter 3 Linear Programming Methods 高等作業研究 高等作業研究 ( 一 ) Chapter 3 Linear Programming Methods (II)
Design Techniques for Approximation Algorithms and Approximation Classes.
Duality Theory LI Xiaolei.
Approximation Algorithms Department of Mathematics and Computer Science Drexel University.
Duality Theory  Every LP problem (called the ‘Primal’) has associated with another problem called the ‘Dual’.  The ‘Dual’ problem is an LP defined directly.
Primal-Dual Algorithms for Connected Facility Location Chaitanya SwamyAmit Kumar Cornell University.
Fast and accurate energy minimization for static or time-varying Markov Random Fields (MRFs) Nikos Komodakis (Ecole Centrale Paris) Nikos Paragios (Ecole.
Linear Programming Revised Simplex Method, Duality of LP problems and Sensitivity analysis D Nagesh Kumar, IISc Optimization Methods: M3L5.
Mechanical Engineering Department 1 سورة النحل (78)
Hon Wai Leong, NUS (CS6234, Spring 2009) Page 1 Copyright © 2009 by Leong Hon Wai CS6234: Lecture 4  Linear Programming  LP and Simplex Algorithm [PS82]-Ch2.
Linear Program Set Cover. Given a universe U of n elements, a collection of subsets of U, S = {S 1,…, S k }, and a cost function c: S → Q +. Find a minimum.
Steiner tree LP x e = 1 if edge e is included in the Steiner tree. Min.  e c e x e (primal) s.t.  e   (S) x e ≥ 1  S  V: S  T≠ , T\S≠  x e 
Approximation Algorithms Department of Mathematics and Computer Science Drexel University.
Hon Wai Leong, NUS (CS6234, Spring 2009) Page 1 Copyright © 2009 by Leong Hon Wai CS6234: Lecture 4  Linear Programming  LP and Simplex Algorithm [PS82]-Ch2.
OR Chapter 7. The Revised Simplex Method  Recall Theorem 3.1, same basis  same dictionary Entire dictionary can be constructed as long as we.
Lecture.6. Table of Contents Lp –rounding Dual Fitting LP-Duality.
The minimum cost flow problem. Solving the minimum cost flow problem.
PRIMAL-DUAL APPROXIMATION ALGORITHMS FOR METRIC FACILITY LOCATION AND K-MEDIAN PROBLEMS K. Jain V. Vazirani Journal of the ACM, 2001.
Approximation Algorithms Duality My T. UF.
Linear Programming Piyush Kumar Welcome to CIS5930.
Ion I. Mandoiu, Vijay V. Vazirani Georgia Tech Joseph L. Ganley Simplex Solutions A New Heuristic for Rectilinear Steiner Trees.
Approximation Algorithms based on linear programming.
Tuesday, March 19 The Network Simplex Method for Solving the Minimum Cost Flow Problem Handouts: Lecture Notes Warning: there is a lot to the network.
Chapter 8 PD-Method and Local Ratio (5) Equivalence This ppt is editored from a ppt of Reuven Bar-Yehuda. Reuven Bar-Yehuda.
Linear Programming Revised Simplex Method, Duality of LP problems and Sensitivity analysis D Nagesh Kumar, IISc Optimization Methods: M3L5.
Chap 10. Sensitivity Analysis
The minimum cost flow problem
6.5 Stochastic Prog. and Benders’ decomposition
Chapter 5. Optimal Matchings
Chapter 4 Linear Programming: The Simplex Method
Analysis of Algorithms
Chapter 3 The Simplex Method and Sensitivity Analysis
Graph Partitioning Problems
1.206J/16.77J/ESD.215J Airline Schedule Planning
Linear Programming and Approximation
Chapter 5. The Duality Theorem
Linear Programming Problem
6.5 Stochastic Prog. and Benders’ decomposition
Constraints.
Presentation transcript:

Combinatorial Interpretations of Dual Fitting and Primal Fitting Ari Freund Cesarea Rothschild Institute, University of Haifa Dror Rawitz Department of Computer Science, Technion

2 Approximation Using LP Duality Minimization problem LP-relaxation and dual: Find x  Z n and y such that w T x  r · b T y  w T x  r · b T y  r · Opt(P)  r · Opt Question: How do we find such solutions?

3 Primal-Dual Schema x and y are constructed simultaneously In each iteration: y is updated such that relaxed dual complementary slackness conditions are satisfied Primal complementary slackness conditions are obeyed Used extensively in the last decade (e.g., [GW95,BT98])

4 A Combinatorial Approach: The Local Ratio Technique Based on weight manipulation Primal-Dual Schema  Local Ratio Technique [BR01] Dual update  Weight subtraction Local Ratio Technique is more intuitive Breakthrough results were achieved due to local ratio (e.g., FVS [BBF99,BG96], Max [BBFNS01]) Conclusion: combinatorial approach is beneficial

5 Metric Uncapacitated Facility Location Problem (MUFL) Non-Standard Applications: 3-approximation algorithm that relaxes primal comp. slackness conditions [JV01] and 1.61-approximation algorithms both using dual fitting [JMMSV03] Motivation: combinatorial interpretations of both non standard applications

6 Dual Fitting Construct an infeasible dual y and a feasible primal x such that w T x  b T y Find r s.t. y/r is feasible w T x  b T y = r · b T (y/r)  r · Opt y y/8 Problem: finding the smallest r s.t. (for all input instances) y/r is feasible.

7 This Work Two new approximation frameworks: Combinatorial Based on weight manipulation (in the spirit of local ratio) Framework1 st  Dual Fitting ExamplesMUFL [JMMSV03] Set Cover [Chv79] * Defined in this paper 2 nd Primal Fitting* MUFL [JV01] Disk Cover [Chu]

8 An Example: Set Cover Input: C = {S 1,…,S m }, S i  U, w : C  R + Solution: C’  C s.t. Measure: Algorithm Greedy: 1. While instance is not empty do: 2. k  argmin i {w(S i ) / |S i |} 3.Add S k to the solution 4.Remove the elements in S k and discard empty sets Approximation ratio is

9 Combinatorial Interpretation Uses weight manipulation A new weight function: w $ = r · w Opt $ = r · Opt w(Solution)  Opt $  Performance ratio r In this case r = H n

10 Combinatorial Interpretation In each iteration: Uncovered elements issue checks Bookkeeping is performed by adjusting weights A weight function  is subtracted from w (and from w $ ) A zero-weight set S k is added to the solution Elements covered by S k retract checks that were given to other sets Checks are not retracted with respect to w $

11 u4u4 u3u3 S3S3 Example S1S1 u1u1 u2u2 S2S2 w 1 =40 w 2 =104 w 3 =  =0  =2  =  =2  =6

12 Analysis - w Consider an element u u is covered by S(u) in iteration j(u) u pays for S(u)  w(Sol) =

13 Analysis – w $ In the j’th iteration: Opt $ decreases by at least |U j | ·  j (“Local Ratio” argument: one check from each element must be cached) Deletion of elements may further decrease Opt $ Also, Opt $ = 0 at termination  Assumption: w $  0 throughout execution Solution is r-approximate

14 Analysis (same as [JMMSV03]) Problem: find min{r | w $  0 at all times} z i - amount paid by u i For fixed d and w(S) S u1u1 u2u2 u3u3 udud z1z1 z2z2 z3z3 zdzd  Approx ratio H n

15 Combinatorial Interpretation of Dual Fitting Dual FittingCombinatorial Framework Increasing a dual variable Subtracting a weight function Dividing y by r (inflated dual) Defining w $ = r · w (inflated weights) wTx  bTywTx  bTyw T x  Opt $ Find r s.t. y/r is feasibleFind r s.t. w $  0 Remark: problem of finding the best r can be formulated using LP, but LP-theory is not used in its solution.

16 Primal Fitting Construct an infeasible primal solution x and a (feasible) dual solution y such that w T x  b T y The primal solution is non integral  r s.t. r ·x is a feasible integral solution  w T (r ·x)= r · w T x  r · b T y  r · Opt Can be used to analyze: 3-approx algorithm for MUFL [JV01] 9-approx algorithm for a disk cover [Chu] Both were originally designed using primal-dual

17 Combinatorial Interpretation of Primal Fitting Primal FittingCombinatorial Framework Increasing a dual variable Subtracting a weight function Multiplying x by r (deflated primal) Defining w $ = w/r (deflated weights) wTx  bTywTx  bTy(w $ ) T (r ·x)  Opt Value of primal variableFraction of weight left

18 The End