Two Dimension Measures: A New Algorithimic Method for Solving NP-Hard Problems Yang Liu.

Slides:



Advertisements
Similar presentations
Bart Jansen 1.  Problem definition  Instance: Connected graph G, positive integer k  Question: Is there a spanning tree for G with at least k leaves?
Advertisements

Greedy Algorithms Greed is good. (Some of the time)
Improved Approximation Algorithms for the Spanning Star Forest Problem Prasad Raghavendra Ning ChenC. Thach Nguyen Atri Rudra Gyanit Singh University of.
Bart Jansen, Utrecht University. 2  Max Leaf  Instance: Connected graph G, positive integer k  Question: Is there a spanning tree for G with at least.
Bart Jansen, Utrecht University. 2  Max Leaf  Instance: Connected graph G, positive integer k  Question: Is there a spanning tree for G with at least.
1 NP-Complete Problems. 2 We discuss some hard problems:  how hard? (computational complexity)  what makes them hard?  any solutions? Definitions 
The Power of Preprocessing Bart M. P. Jansen September 29th, Algorithms & Visualization seminar, TU Eindhoven.
© The McGraw-Hill Companies, Inc., Chapter 8 The Theory of NP-Completeness.
Algorithm Strategies Nelson Padua-Perez Chau-Wen Tseng Department of Computer Science University of Maryland, College Park.
PCPs and Inapproximability Introduction. My T. Thai 2 Why Approximation Algorithms  Problems that we cannot find an optimal solution.
Introduction to Approximation Algorithms Lecture 12: Mar 1.
Approximation Algoirthms: Semidefinite Programming Lecture 19: Mar 22.
Semidefinite Programming
Randomized Algorithms for the Loop Cutset Problem Author: Ann Becker, Beuven Bar-Yehuda Dan Geiger Beuven Bar-Yehuda Dan Geiger Class presentation for.
UMass Lowell Computer Science Analysis of Algorithms Prof. Karen Daniels Fall, 2006 Lecture 2 Monday, 9/13/06 Design Patterns for Optimization Problems.
Implicit Hitting Set Problems Richard M. Karp Harvard University August 29, 2011.
UMass Lowell Computer Science Analysis of Algorithms Prof. Karen Daniels Fall, 2002 Monday, 12/2/02 Design Patterns for Optimization Problems Greedy.
Increasing graph connectivity from 1 to 2 Guy Kortsarz Joint work with Even and Nutov.
Exact Algorithms for Hard Problems An introduction.
Randomized Process of Unknowns and Implicitly Enforced Bounds on Parameters Jianer Chen Department of Computer Science & Engineering Texas A&M University.
An Approximation Algorithm for Requirement cut on graphs Viswanath Nagarajan Joint work with R. Ravi.
Joint with Christian KnauerFreie U., Berlin Andreas SpillnerJena Takeshi TokuyamaTohoku University Alexander WolffUniversity of Karlsruhe Algorithms for.
Randomness in Computation and Communication Part 1: Randomized algorithms Lap Chi Lau CSE CUHK.
Steiner trees Algorithms and Networks. Steiner Trees2 Today Steiner trees: what and why? NP-completeness Approximation algorithms Preprocessing.
Linear Programming and Parameterized Algorithms. Linear Programming n real-valued variables, x 1, x 2, …, x n. Linear objective function. Linear (in)equality.
1 Refined Search Tree Technique for Dominating Set on Planar Graphs Jochen Alber, Hongbing Fan, Michael R. Fellows, Henning Fernau, Rolf Niedermeier, Fran.
Packing Element-Disjoint Steiner Trees Mohammad R. Salavatipour Department of Computing Science University of Alberta Joint with Joseph Cheriyan Department.
Data reduction lower bounds: Problems without polynomial kernels Hans L. Bodlaender Joint work with Downey, Fellows, Hermelin, Thomasse, Yeo.
Fixed Parameter Complexity Algorithms and Networks.
1 Introduction to Approximation Algorithms. 2 NP-completeness Do your best then.
MCS312: NP-completeness and Approximation Algorithms
Fixed Parameter Complexity Algorithms and Networks.
Simple and Improved Parameterized Algorithms for Multiterminal Cuts Mingyu Xiao The Chinese University of Hong Kong Hong Kong SAR, CHINA CSR 2008 Presentation,
Bold Stroke January 13, 2003 Advanced Algorithms CS 539/441 OR In Search Of Efficient General Solutions Joe Hoffert
Kernel Bounds for Structural Parameterizations of Pathwidth Bart M. P. Jansen Joint work with Hans L. Bodlaender & Stefan Kratsch July 6th 2012, SWAT 2012,
Approximating Minimum Bounded Degree Spanning Tree (MBDST) Mohit Singh and Lap Chi Lau “Approximating Minimum Bounded DegreeApproximating Minimum Bounded.
1 Introduction to Approximation Algorithms. 2 NP-completeness Do your best then.
1 Bart Jansen Vertex Cover Kernelization Revisited: Upper and Lower Bounds for a Refined Parameter STACS 2011, Dortmund March 10 th, 2011 Joint work with.
The Graph Minor Theorem CS594 GRAPH THEORY PRESENTATION SPRING 2014 RON HAGAN.
Constructing evolutionary trees from rooted triples Bang Ye Wu Dept. of Computer Science and Information Engineering Shu-Te University.
Approximation Algorithms
1 Steiner Tree Algorithms and Networks 2014/2015 Hans L. Bodlaender Johan M. M. van Rooij.
Search by partial solutions.  nodes are partial or complete states  graphs are DAGs (may be trees) source (root) is empty state sinks (leaves) are complete.
1 Efficient Obstacle-Avoiding Rectilinear Steiner Tree Construction Chung-Wei Lin, Szu-Yu Chen, Chi-Feng Li, Yao-Wen Chang, Chia-Lin Yang National Taiwan.
CSE 589 Part VI. Reading Skiena, Sections 5.5 and 6.8 CLR, chapter 37.
Experimental Study of Directed Feedback Vertex Set Problem With Rudolf Fleischer and Liwei Yuan Fudan University, Shanghai Xi Wu.
The Dominating Set and its Parametric Dual  the Dominated Set  Lan Lin prepared for theory group meeting on June 11, 2003.
Speeding Up Enumeration Algorithms with Amortized Analysis Takeaki Uno (National Institute of Informatics, JAPAN)
CSE 589 Part V One of the symptoms of an approaching nervous breakdown is the belief that one’s work is terribly important. Bertrand Russell.
Subtree Prune Regraft & Horizontal Gene Transfer or Recombination.
Variations of the Prize- Collecting Steiner Tree Problem Olena Chapovska and Abraham P. Punnen Networks 2006 Reporter: Cheng-Chung Li 2006/08/28.
Vasilis Syrgkanis Cornell University
Data Reduction for Graph Coloring Problems Bart M. P. Jansen Joint work with Stefan Kratsch August 22 nd 2011, Oslo.
Graph Algorithms Maximum Flow - Best algorithms [Adapted from R.Solis-Oba]
Outline Standard 2-way minimum graph cut problem. Applications to problems in computer vision Classical algorithms from the theory literature A new algorithm.
Exponential time algorithms Algorithms and networks.
Algorithms for hard problems Parameterized complexity – definitions, sample algorithms Juris Viksna, 2015.
Algorithms for hard problems Introduction Juris Viksna, 2015.
NPC.
Indian Institute of Technology Kharagpur PALLAB DASGUPTA Graph Theory: Trees Pallab Dasgupta, Professor, Dept. of Computer Sc. and Engineering, IIT
Kernel Bounds for Path and Cycle Problems Bart M. P. Jansen Joint work with Hans L. Bodlaender & Stefan Kratsch September 8 th 2011, Saarbrucken.
Graphs and Algorithms (2MMD30)
Introduction to Approximation Algorithms
Hans Bodlaender, Marek Cygan and Stefan Kratsch
Lecture 22 Complexity and Reductions
Parameterised Complexity
Bart M. P. Jansen June 3rd 2016, Algorithms for Optimization Problems
Trees.
Graphs and Algorithms (2MMD30)
Hamiltonicity below Dirac’s condition
Presentation transcript:

Two Dimension Measures: A New Algorithimic Method for Solving NP-Hard Problems Yang Liu

Outlines Why Exact Algorithms Why Fpt-algorithms Algorithmic techniques: branching search tree and two dimension braching search tree Previous works Future research

Why NP-Hard Problems Abundant aplications Methods of tackling NP-hard problems: 1. Exact algorithms. 2. parameterized algorithms 3. Approximation algorithms 4. Heuristics

Why Exact Algorithms Optimal Correct and meaningful for decision problems Subroutine for other methods Limitation of the improvements of processors

Practical Examples (1) The Rectlinear Steiner Tree problem Inputs of size up to 1000 Solved in 38 CPU hours.

Practical Examples (2) The TSP problem ( German15,112 towns In cpu years Sweden24,978 Towns In ,5000 km Circuit33,810In ,048,945 units, 15.7 cpu years Circuit85,900In cpu years

Outlines Why Exact Algorithms Why Fpt-algorithms Algorithmic technique: branching search tree and two dimensional braching search tree Previous works Proposed future research

Why FPT-algorithms Still hard to design practical exact algorithms in general An application may have a parameter k, small compared with input size n. This parameter can give a better bound on time complexity, like O(f(k)n c ).

Practical Fpt-algorithms (1) Type check: checking the compatibility of type declarations. Parameter k: the maximum nesting depth of the type declarations. Normally K<=6 Practical fpt-algorithm of time O(2 k n)

Practical Fpt-algorithms (2) Individual halotyping problem Paramters k 1 and k 2 K 1 <=n, but normally k 1 <=10 Usually k 2 <=19 Practical fpt-algorithm of complexity O(nk 2 2 k2 +mlogm+mk 1 )

Outlines Why Exact Algorithms Why Fpt-algorithms Algorithmic techniques: branching search tree and two dimension braching search tree Previous works Proposed future research

Algorithmic Techniques Kernelization, greedy localization, iterative compression, coloring coding, divide cand conquer, divide and coloring, branching search tree Dynamic programming, prunning the search tree, preprocess the data, local search, measure and conquer

Branching Search Tree m m2m2 m1m1 mpmp m’ m: measure f(m): number of subproblems (poly-time solvable)

Time Complexity of Branching Search Tree Complexity: O(c m poly(n))=O*(c m ). O*(c n ) refers to O(c n poly(n)).

Example: Exact Algorithm Finding Minimum Vertex Cover C Pick an edge xy, let measure m=#vertices m=n m 1 =n-1 m p =n-2 x in C x not in C y in C

Example: fpt-Algorithm Finding a vertex cover C of k vertices. Pick an edge xy, let measure m=#vertices needs to be in C m m 1 =m-1 m p =m-1 x in C x not in C y in C

Weakness of Branching Search Tree Only takes one measure Finding a feedback vertex set fvs of k vertices Choose a cycle and one vertex must be in fvs.

Two Dimensional Braching Search Tree Challenges: Finding two measures p,q how to bound f(p,q) Boundary conditions: new combinatorial properties Acheivements:  faster algorithms for some problems.

Outlines Why Exact Algorithms Why Fpt-algorithms Algorithmic technique: branching search tree and two dimensional braching search tree Previous works Proposed future research

3D Matching & 3-Set Packing a1a1 a2a2 anan b1b1 b2b2 bnbn c1c1 c2c2 cncn Symbols: a i, b i, c i a3a3 b3b3 c3c triples Set U of symbols, triple t= t1= and t2= conflicts if a i =b i for some i A matching: set of mutually non- conflicting triples. The maximum matching problem In the Karp’s list of NP-complete problems Generalization of graph matching

3D Matching & Packing Finding a matching of k triples ReferenceRandomDeterm Downey et al.O*((3k)!(3k) 9k+1 ) Chen et al.O*((5.7k) k ) KoutisO*( k )>O*( k ) Fellows et al.>O*(126 3k ) KneisO*(2.52 3k )O*(16 3k ) Chen et al.O*(2.52 3k )O*(12.8 3k ) Our resultO*(2.32 3k )O*(2.77 3k )

3D Matching & Packing For the k-packing problem, most algorithms in the table above apply. Our algorithm has complexity O*(4.61 3k ) Remark: Koutis gave a randomized algorithm of time O*(2 3k ) for both k- matching and k-packing problems

Multiway Cut

terminals

Multiway Cut terminals separator

Multiway Cut Applications: distributed computing, VLSI, computer vision and more Finding a separator of k vertices An algorithm of time O*(4 k ) the previous best algorithm of time

Feedback Vertex Set (undirected graphs)

Feedback vertex set Remaining graph is a forest

Finding an FVS of k vertices (undirected graphs) ReferenceComplexity Bodlaender, FellowsO*(17(k4)!) Dowey and FellowsO*((2k+1) k ) Raman et al.O*(max{12 k,(4logk) k }) Kanj et al.O*((2logk+2loglogk+18) k ) Raman et al.O*((12logk/loglogk+6) k ) Guo et al.O*(37.7 k ) Dehne et al.O*(10.6 k ) Our resultsO*(5 k )

Feedback Vertex Set (directed graphs)

Feedback vertex set Remaining graph is a DAG

Finding an FVS of k vertices (directed graphs) Question: fpt or not? Had been an open problem for over 15 years We developed an algorithm of time O*(4 k k!) with our new approach

Finding an FVS of k vertices (undirected graphs) ReferenceComplexity Bodlaender, FellowsO*(17(k4)!) Dowey and FellowsO*((2k+1) k ) Raman et al.O*(max{12 k,(4logk) k }) Kanj et al.O*((2logk+2loglogk+18) k ) Raman et al.O*((12logk/loglogk+6) k ) Guo et al.O*(37.7 k ) Dehne et al.O*(10.6 k ) Our resultsO*(5 k )

Finding an FVS of k vertices (directed graphs) Question: fpt or not? Had been open for over 15 years We developed an algorithm of time O*(4 k k!) Accepted by STOC 2008, JACM

Max Leaf (undirected graphs) Finding a Spanning tree With at least k leaves Equivalent to the minimum connected dominating set problem Applications: design of communication networks, circuit layouts, and distributed systems.

Finding a spanning tree with k leaves ReferenceComplexity BodlaenderO*((17k 4 )!) Downey and FellowsO*((2k) 4k ) Fellows et al.O*(14.23 k ) Bonsma et al.O*(9.49 k ) Bonsma and ZickfeldO*(6.75 k ) Our resultO*(4 k )

Out-branching Out-branching: a rooted tree such that there is a unique path from the root to a leaf.

Finding an out-branching with k leaves More difficult Graph minor theory on digraphs is not mature enough to solve this problem Properties are harder to prove for digraphs than for undirected graphs Shown to be fpt only recently

Finding an out-branching with k leaves for SCC and DAG for SCC and for DAG for digraphs Our results: O*(4 k ) Remark: Kenis et al. developed similar algorithm.

Max Leaf Finding a spanning tree of maximum leaves Equal to minimum connected dominating set Applications: design of communication networks, circuit layouts, and distributed systems.

Max Leaf on Digraphs Out-branching: a rooted tree such that there is a unique path from the root to a leaf. Max Leaf: finding an out-branching with maximum leaves Approximable within

Finding an out-branching with k leaves More difficult Graph minor theory on digraphs is not mature enough to solve this problem Some property is harder to prove for digraphs than for undirected graphs Shown to be fpt 15 years later

Finding an out-branching with k leaves for SCC and DAG for SCC and for DAG for digraphs Our results: O*(4 k )

Outlines Why Exact Algorithms Why Fpt-algorithms Algorithmic technique: branching search tree and two dimensional braching search tree Previous works Proposed future research

Multiway Cut Can we improve the algorithm of O*(4 k )? Is there any faster or simpler randomized algorithm? Is there any algebraic algorithms for this problem? Is the multi-cut problem fpt?

Feedback Vertex Set Can we improve the current best algorithms? Is there randomized algorithm better than O*(4 k )? Is there a deterministic algorithm of O*(4 k ) for the problem on undirected graphs? Is there O*(c k ) for the problem on digraphs? Is there any algebraic algorithm?

Max Leaf Is there any better algorithm? Is there any better algorithm for the problem on undirected graphs? Is there any faster or simple randomized algorithm? Is there any algebraic algorithm?

Two Dimension Measures: Further Study Algorithms by this technique has complexity around O*(4 k ) Can we do better? How? Can we apply this or similar technique to design exact algorithms?

Conclusion Two dimension measures branching search tree is powerful in design fpt- algorithms. Need improvement on this technique to design algorithms faster than O*(4 k ). Generalize this technique to design exact algorithms.

Questions? Thank You!