1 Robustness by cutting planes and the Uncertain Set Covering Problem AIRO 2008, Ischia, 10 September 2008 (work supported my MiUR and EU) Matteo Fischetti.

Slides:



Advertisements
Similar presentations
Iterative Rounding and Iterative Relaxation
Advertisements

Integer Optimization Basic Concepts Integer Linear Program(ILP): A linear program except that some or all of the decision variables must have integer.
Submodular Set Function Maximization via the Multilinear Relaxation & Dependent Rounding Chandra Chekuri Univ. of Illinois, Urbana-Champaign.
1 LP Duality Lecture 13: Feb Min-Max Theorems In bipartite graph, Maximum matching = Minimum Vertex Cover In every graph, Maximum Flow = Minimum.
SCIP Optimization Suite
Approximation Algorithms Chapter 14: Rounding Applied to Set Cover.
Crew Scheduling Housos Efthymios, Professor Computer Systems Laboratory (CSL) Electrical & Computer Engineering University of Patras.
EMIS 8373: Integer Programming Valid Inequalities updated 4April 2011.
1 1 Slide © 2008 Thomson South-Western. All Rights Reserved Slides by JOHN LOUCKS St. Edward’s University.
Complexity 16-1 Complexity Andrei Bulatov Non-Approximability.
1 State of the art for TSP TSP instances of thousand of cities can be consistently solved to optimality. Instances of up to cities have been solved:
1 Polynomial Church-Turing thesis A decision problem can be solved in polynomial time by using a reasonable sequential model of computation if and only.
1 Optimization problems such as MAXSAT, MIN NODE COVER, MAX INDEPENDENT SET, MAX CLIQUE, MIN SET COVER, TSP, KNAPSACK, BINPACKING do not have a polynomial.
Mathematical Modeling and Optimization: Summary of “Big Ideas”
Implicit Hitting Set Problems Richard M. Karp Harvard University August 29, 2011.
1 Maximum matching Max Flow Shortest paths Min Cost Flow Linear Programming Mixed Integer Linear Programming Worst case polynomial time by Local Search.
Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin Company, for the United States Department of Energy under contract.
Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin Company, for the United States Department of Energy under contract.
Distributed Combinatorial Optimization
Lift-and-Project cuts: an efficient solution method for mixed-integer programs Sebastian Ceria Graduate School of Business and Computational Optimization.
Daniel Kroening and Ofer Strichman Decision Procedures An Algorithmic Point of View Deciding ILPs with Branch & Bound ILP References: ‘Integer Programming’
1 Lecture 4 Maximal Flow Problems Set Covering Problems.
Decision Procedures An Algorithmic Point of View
1.3 Modeling with exponentially many constr.  Some strong formulations (or even formulation itself) may involve exponentially many constraints (cutting.
1 1 Slide © 2005 Thomson/South-Western Chapter 8 Integer Linear Programming n Types of Integer Linear Programming Models n Graphical and Computer Solutions.
1 1 Slide Integer Linear Programming Professor Ahmadi.
1 1 Slide Integer Linear Programming Professor Ahmadi.
Mathematical Modeling and Optimization: Summary of “Big Ideas”
Linear Programming Topics General optimization model LP model and assumptions Manufacturing example Characteristics of solutions Sensitivity analysis Excel.
Approximation Algorithms Department of Mathematics and Computer Science Drexel University.
Workforce scheduling – Days off scheduling 1. n is the max weekend demand n = max(n 1,n 7 ) Surplus number of employees in day j is u j = W – n j for.
Chapter 1. Formulations 1. Integer Programming  Mixed Integer Optimization Problem (or (Linear) Mixed Integer Program, MIP) min c’x + d’y Ax +
WOOD 492 MODELLING FOR DECISION SUPPORT
Chap 10. Integer Prog. Formulations
Gomory Cuts Updated 25 March Example ILP Example taken from “Operations Research: An Introduction” by Hamdy A. Taha (8 th Edition)“Operations Research:
Branch-and-Cut Valid inequality: an inequality satisfied by all feasible solutions Cut: a valid inequality that is not part of the current formulation.
Integer Programming (정수계획법)
Approximation Algorithms Department of Mathematics and Computer Science Drexel University.
Implicit Hitting Set Problems Richard M. Karp Erick Moreno Centeno DIMACS 20 th Anniversary.
Chapter 2. Optimal Trees and Paths Combinatorial Optimization
Chapter 8 Integer Linear Programming n Types of Integer Linear Programming Models n Graphical and Computer Solutions for an All- Integer Linear Program.
Integer Bounds on Suppressed Cells in Multi-Way Tables Stephen F. Roehrig Carnegie Mellon University For.
Intersection Cuts for Bilevel Optimization
Approximation Algorithms for the Traveling Salesman Problem Shayan Oveis Gharan.
Forward and Backward Deviation Measures and Robust Optimization Peng Sun (Duke) with Xin Chen (UIUC) and Melvyn Sim (NUS)
Approximation Algorithms based on linear programming.
Discrete Optimization MA2827 Fondements de l’optimisation discrète Material from P. Van Hentenryck’s course.
Integer Programming An integer linear program (ILP) is defined exactly as a linear program except that values of variables in a feasible solution have.
From Mixed-Integer Linear to Mixed-Integer Bilevel Linear Programming
Solver & Optimization Problems
Exact Algorithms for Mixed-Integer Bilevel Linear Programming
Approximation algorithms
6.5 Stochastic Prog. and Benders’ decomposition
Matteo Fischetti, University of Padova
Gomory Cuts Updated 25 March 2009.
1.3 Modeling with exponentially many constr.
Chapter 6. Large Scale Optimization
Integer Programming (정수계획법)
2. Generating All Valid Inequalities
Chapter 1. Formulations (BW)
1.3 Modeling with exponentially many constr.
Integer Programming (정수계획법)
Part II General Integer Programming
6.5 Stochastic Prog. and Benders’ decomposition
Graphical solution A Graphical Solution Procedure (LPs with 2 decision variables can be solved/viewed this way.) 1. Plot each constraint as an equation.
Intersection Cuts from Bilinear Disjunctions
Chapter 1. Formulations.
Chapter 6. Large Scale Optimization
Intersection Cuts for Quadratic Mixed-Integer Optimization
Discrete Optimization
Presentation transcript:

1 Robustness by cutting planes and the Uncertain Set Covering Problem AIRO 2008, Ischia, 10 September 2008 (work supported my MiUR and EU) Matteo Fischetti Michele Monaci DEI, University of Padova

2 Motivation A typical assumption in combinatorial optimization: The exact values of all input data are known in advance This assumption can be violated in practical (real-world) applications The optimal solution, even if computed very accurately, can be very hard to implement accurately The solution found using nominal values of the parameters can be sub- optimal or even infeasible Small uncertainty in the data can make the nominal optimal solution completely meaningless from a practical viewpoint.

3 Dealing with Uncertainty Nominal problem (LP) We assume that each coefficient a ij of matrix A can take any value ã ij in the interval [a ij – â ij, a ij + â ij ] Bertsimas and Sim (BS’04): a solution is considered robust if it remains feasible when at most Γ i coefficients in each row i take their worst value min { c T x: Ax ≤ b, x ≥ 0 }

4 Compact formulation Replace the i-th row with its robust counterpart where represents the level of protection of the solution with respect to row Using LP duality, BS obtained a compact formulation for the robust LP involving a substantial n. of additional var.s and constraints β(Γ i, x) = max { ∑ jЄS a ij x j, |S| ≤ Γ i } a i T x + β(Γ i, x) ≤ b i

5 Robustness by cutting planes Robustness of the solution with respect to row i can alternatively be imposed by means of robustness cuts This allows one to work on the original variable space but requires to handle an exponential number of constraints. –Cutting planes approach –Separation of the current solution x* can be carried out in linear time: select the (at most) Γ i variables with largest positive values of ∑ jЄN a ij x j + ∑ jЄS â ij x j ≤ b i, for all S: |S| ≤ Γ i

6 LP instances: computational experiments CPU seconds on a PC AMD Athlon using Cplex 11.0 For each coefficient: For each row, (constant) â ij = a ij /100Γ i = Γ (instances from NETLIB)

7 Cutting planes as the only option There are situations where cutting planes are the only possible way to deal with uncertainty Indeed, compact formulation by BS cannot be applied, e.g., when the nominal formulation of the problem is itself noncompact (e.g., TSP) when the uncertainty domain cannot be fully described by a linear system –e.g., when the uncertainty domain involves yes-no decisions that cannot be modeled by continuous variables.  Uncertain set covering problems

8 The Uncertain Set Covering Problem Classical set covering problem Given a n x m binary matrix A and a cost c j for each column j find a minimum-cost set S of columns such that each row is covered by (at least) one selected column Uncertain counterpart (USCP) Each column j has a positive (independent) probability p j of disappearing, and each row must be covered with a probability larger than a given threshold P USCP arises, e.g., in crew scheduling applications where each pairing can be unavailable due to uncertainty (driver’s nonshow) Prob(a i T x ≥ 1 ) > P, for all row i

9 Modeling USCP Basic ILP model (M1): each row i must be covered by a set of columns having a small probability of disappearing all together –Separation problem can be solved quickly (knapsack problem) Alternative compact ILP model (M2), exploiting a ij and x j binaries: with ∑ jЄN\S a ij x j ≥ 1 for all S: ∏ jЄS p j > 1-P Prob(a i T x ≥ 1 ) > P ∏ jЄN a ij x j p j ≤ 1 - P Probabilities are independent one each other Apply logarithm to both terms ∑ jЄN a ij w j x j ≥ W (*) w j = -log(p j ), W = -log(1-P) Probability that the selected col.s covering row i disappear all together

10 Modeling USCP The models are equivalent in terms of integer solutions, but the associated LP relaxations are different (and no dominance exists among them) Constraints can be strengthened –Replacing w j with w’ j = min{w j, W} –With a rounding argument akin to Gomory’s fractional cuts; given a positive integer k, the following inequality is valid for USCP where v ij are “small integer” defined as (k-1)a ij w j /(W-ε) rounded up No dominance exists between (*) and (**) These new constraints make the model more stable from a numerical point of view. ∑ jЄN v ij x j ≥ k (**) ∑ jЄN a ij w j x j ≥ W (*)

11 USCP: computational experiments Test instances randomly derived from some SCP instances in the ORlibrary. All probabilities are randomly generated in [0, 0.2]. Required probability: P = {0.90, 0.95} Both ILP models solved using Cplex 11.0

12 Uncertain graph connectivity Given an undirected graph with costs and probabilities associated with edges, find a min-cost partial graph that is connected with a given probability P (NP-hard) Arises e.g. in the design of reliable telecommunication network ILP formulation min ∑ eЄE c e x e Prob(∑ eЄδ(S) x e ≥ 1) > P for each proper nodeset S x binary Assuming probabilities to be independent, the constraint associated with a given subset S reads ∑ eЄδ(S) w e x e ≥ W

13 Computational experiments Test instances randomly derived from some TSP instances in the TSPLIB. All probabilities are randomly generated in [0, 0.2]. Required probability: P = {0.85, 0.90, 0.95, 0.99} Branch-and-cut embedded within Cplex 11.0

14 Uncertain (?!) Plots