DNF Sparsification and Counting

Slides:



Advertisements
Similar presentations
How to Solve Longstanding Open Problems In Quantum Computing Using Only Fourier Analysis Scott Aaronson (MIT) For those who hate quantum: The open problems.
Advertisements

DNF Sparsification and Counting Raghu Meka (IAS, Princeton) Parikshit Gopalan (MSR, SVC) Omer Reingold (MSR, SVC)
Introduction to Kernel Lower Bounds Daniel Lokshtanov.
Queries with Difference on Probabilistic Databases Sanjeev Khanna Sudeepa Roy Val Tannen University of Pennsylvania 1.
Counting Algorithms for Knapsack and Related Problems 1 Raghu Meka (UT Austin, work done at MSR, SVC) Parikshit Gopalan (Microsoft Research, SVC) Adam.
Better Pseudorandom Generators from Milder Pseudorandom Restrictions Raghu Meka (IAS) Parikshit Gopalan, Omer Reingold (MSR-SVC) Luca Trevian (Stanford),
Derandomization: New Results and Applications Emanuele Viola Harvard University March 2006.
1 Polynomial Church-Turing thesis A decision problem can be solved in polynomial time by using a reasonable sequential model of computation if and only.
Arithmetic Hardness vs. Randomness Valentine Kabanets SFU.
NP-Complete Problems Reading Material: Chapter 10 Sections 1, 2, 3, and 4 only.
1 Polynomial Time Reductions Polynomial Computable function : For any computes in polynomial time.
NP-Complete Problems Problems in Computer Science are classified into
Complexity 19-1 Complexity Andrei Bulatov More Probabilistic Algorithms.
Computability and Complexity 24-1 Computability and Complexity Andrei Bulatov Approximation.
Pseudorandom Generators for Combinatorial Shapes 1 Parikshit Gopalan, MSR SVC Raghu Meka, UT Austin Omer Reingold, MSR SVC David Zuckerman, UT Austin.
February 18, 2015CS21 Lecture 181 CS21 Decidability and Tractability Lecture 18 February 18, 2015.
Theory of Computing Lecture 17 MAS 714 Hartmut Klauck.
NP Complexity By Mussie Araya. What is NP Complexity? Formal Definition: NP is the set of decision problems solvable in polynomial time by a non- deterministic.
An FPTAS for #Knapsack and Related Counting Problems Parikshit Gopalan Adam Klivans Raghu Meka Daniel Štefankovi č Santosh Vempala Eric Vigoda.
Week 10Complexity of Algorithms1 Hard Computational Problems Some computational problems are hard Despite a numerous attempts we do not know any efficient.
1 The Theory of NP-Completeness 2 Cook ’ s Theorem (1971) Prof. Cook Toronto U. Receiving Turing Award (1982) Discussing difficult problems: worst case.
My Favorite Ten Complexity Theorems of the Past Decade II Lance Fortnow University of Chicago.
CSE 6311 – Spring 2009 ADVANCED COMPUTATIONAL MODELS AND ALGORITHMS Lecture Notes – Feb. 3, 2009 Instructor: Dr. Gautam Das notes by Walter Wilson.
NPC.
NP Completeness Piyush Kumar. Today Reductions Proving Lower Bounds revisited Decision and Optimization Problems SAT and 3-SAT P Vs NP Dealing with NP-Complete.
Young CS 331 D&A of Algo. NP-Completeness1 NP-Completeness Reference: Computers and Intractability: A Guide to the Theory of NP-Completeness by Garey and.
1 1. Which of these sequences correspond to Hamilton cycles in the graph? (a) (b) (c) (d) (e)
The NP class. NP-completeness Lecture2. The NP-class The NP class is a class that contains all the problems that can be decided by a Non-Deterministic.
P, NP, NP-completeness 2 Reductions 1 Thu, July 7 th 1.
ICS 353: Design and Analysis of Algorithms NP-Complete Problems King Fahd University of Petroleum & Minerals Information & Computer Science Department.
NP-Completeness A problem is NP-complete if: It is in NP
The NP class. NP-completeness
Chapter 10 NP-Complete Problems.
Computational Complexity Theory
Richard Anderson Lecture 26 NP-Completeness
Introduction to Machine Learning
Computability and Complexity
Richard Anderson Lecture 26 NP-Completeness
Circuit Lower Bounds A combinatorial approach to P vs NP
Richard Anderson Lecture 25 Min Cut Applications and NP-Completeness
Monomer-dimer model and a new deterministic approximation algorithm for computing a permanent of a 0,1 matrix David Gamarnik MIT Joint work with Dmitriy.
NP-Completeness Yin Tat Lee
Intro to Theory of Computation
Intro to Theory of Computation
Queries with Difference on Probabilistic Databases
Tight Fourier Tails for AC0 Circuits
ICS 353: Design and Analysis of Algorithms
Complexity 6-1 The Class P Complexity Andrei Bulatov.
Richard Anderson Lecture 25 NP-Completeness
NP-Completeness Proofs
Computational Complexity
Time Complexity We use a multitape Turing machine
Chapter 11 Limitations of Algorithm Power
NP-Complete Problems.
CS21 Decidability and Tractability
CSC 380: Design and Analysis of Algorithms
NP-Completeness Yin Tat Lee
CSE 6408 Advanced Algorithms.
NP-Completeness Reference: Computers and Intractability: A Guide to the Theory of NP-Completeness by Garey and Johnson, W.H. Freeman and Company, 1979.
CSE 589 Applied Algorithms Spring 1999
CS151 Complexity Theory Lecture 7 April 23, 2019.
Richard Anderson Lecture 25 NP Completeness
Instructor: Aaron Roth
RAIK 283 Data Structures & Algorithms
On Derandomizing Algorithms that Err Extremely Rarely
Recent Structure Lemmas for Depth-Two Threshold Circuits
Stronger Connections Between Circuit Analysis and Circuit Lower Bounds, via PCPs of Proximity Lijie Chen Ryan Williams.
Presentation transcript:

DNF Sparsification and Counting Raghu Meka (IAS, work done at MSR, SVC) Parikshit Gopalan (MSR, SVC) Omer Reingold (MSR, SVC)

Can we Count? Count proper 4-colorings? 533,816,322,048! O(1)

Can we Count? Count satisfying solutions to a 2-SAT formula? Count satisfying solutions to a DNF formula? Count satisfying solutions to a CNF formula? Seriously?

Counting vs Solving Counting interesting even if solving “easy”. Four colorings: Always solvable!

Counting vs Solving Counting interesting even if solving “easy”. Matchings Solving – Edmonds 65 Counting – Jerrum, Sinclair 88 Jerrum, Sinclair Vigoda 01

Counting vs Solving Counting interesting even if solving “easy”. Spanning Trees Counting/Sampling: Kirchoff’s law, Effective resistances

Counting vs Solving Counting interesting even if solving “easy”. Thermodynamics = Counting

Conjunctive Normal Formulas Width w Size m

Conjunctive Normal Formulas Extremely well studied complexity class Width three = 3-SAT

Disjunctinve Normal Formulas Extremely well studied complexity class

Counting for CNFs/DNFs INPUT: CNF f OUTPUT: No. of accepting solutions INPUT: DNF f OUTPUT: No. of accepting solutions #P-Hard

Counting for CNFs/DNFs INPUT: CNF f OUTPUT: Approximation for No. of solutions INPUT: DNF f OUTPUT: Approximation for No. of solutions

Approximate Counting Focus on additive for good reason Additive error: Compute p Focus on additive for good reason

Counting for CNFs/DNFs Randomized algorithm: Sample and check “The best throw of the die is to throw it away” -

Why Deterministic Counting? #P introduced by Valiant in 1979. Can’t solve #P-hard problems exactly. Duh. Approximate Counting ~ Random Sampling Jerrum, Valiant, Vazirani 1986 Derandomizing simple classes is important. Primes is in P - Agarwal, Kayal, Saxena 2001 SL=L – Reingold 2005 CNFs/DNFs as simple as they get Triggered counting through MCMC: Eg., Matchings (Jerrum, Sinclair, Vigoda 01) Does counting require randomness?

Counting for CNFs/DNFs Karp, Luby 83 – MCMC counting for DNFs Reference Run-Time Ajtai, Wigderson 85 Sub-exponential Nisan, Wigderson 88 Quasi-polynomial Luby, Velickovic, Wigderson Luby, Velickovic 91 Better than quasi, but worse than poly. No improvemnts since!

Our Results Main Result: A deterministic algorithm. New structural result on CNFs New approach to Switching lemma Fundamental result about CNFs/DNFs, Ajtai 83, Hastad 86; Proof mysterious More intuitive approach, derandomizable

Our Algorithm Step 1: Reduce to small-width Same as Luby-Velickovic Step 2: Solve small-width directly Structural result: width buys size

Size does not depend on n or m! Width vs Size Size does not depend on n or m! How big can a width w CNF be? Eg., Can width = O(1), size = poly(n)? (Recall: width = max-length of clause size = no. of clauses)

Proof of Structural result Observation 1: Many disjoint clauses => small acceptance prob.

Proof of Structural result 2: Many clauses => some (essentially) disjoint Assume no negations. Clauses ~ subsets of variables. (Core) Petals

Proof of Structural result 2: Many clauses => some (essentially) disjoint Many small sets => Large

Lower Sandwiching CNF Error only if all petals satisfied k large => error small Repeat until CNF is small

Upper Sandwiching CNF Error only if all petals satisfied k large => error small Repeat until CNF is small

Main Structural Result Setting parameters properly: Use “quasi-sunflowers” (Rossman 10) with same analysis: Suffices for counting result. Not the dependence we promised.

Structural Result Necessary: Tribes function – clauses on disjoint sets of variables

Thank you