Subhash Khot IAS Elchanan Mossel UC Berkeley Guy Kindler DIMACS Ryan O’Donnell IAS.

Slides:



Advertisements
Similar presentations
Optimal Lower Bounds for 2-Query Locally Decodable Linear Codes Kenji Obata.
Advertisements

Hardness of Reconstructing Multivariate Polynomials. Parikshit Gopalan U. Washington Parikshit Gopalan U. Washington Subhash Khot NYU/Gatech Rishi Saket.
Guy Kindler Weizmann Institute. Well try to understand some notions, and their relations: Combinatorial optimization problems Combinatorial optimization.
Uri Feige Microsoft Understanding Parallel Repetition Requires Understanding Foams Guy Kindler Weizmann Ryan ODonnell CMU.
Linear-Degree Extractors and the Inapproximability of Max Clique and Chromatic Number David Zuckerman University of Texas at Austin.
LEARNIN HE UNIFORM UNDER DISTRIBUTION – Toward DNF – Ryan ODonnell Microsoft Research January, 2006.
Parallel Repetition of Two Prover Games Ran Raz Weizmann Institute and IAS.
Extracting Randomness From Few Independent Sources Boaz Barak, IAS Russell Impagliazzo, UCSD Avi Wigderson, IAS.
Vertex cover might be hard to approximate within 2 - ε Subhash Khot, Oded Regev Slides by: Ofer Neiman.
A threshold of ln(n) for approximating set cover By Uriel Feige Lecturer: Ariel Procaccia.
The Unique Games Conjecture and Graph Expansion School on Approximability, Bangalore, January 2011 Joint work with S Prasad Raghavendra Georgia Institute.
Inapproximability of Hypergraph Vertex-Cover. A k-uniform hypergraph H= : V – a set of vertices E - a collection of k-element subsets of V Example: k=3.
Hardness of Approximating Multicut S. Chawla, R. Krauthgamer, R. Kumar, Y. Rabani, D. Sivakumar (2005) Presented by Adin Rosenberg.
Computational Applications of Noise Sensitivity Ryan O’Donnell.
Inapproximability of MAX-CUT Khot,Kindler,Mossel and O ’ Donnell Moshe Ben Nehemia June 05.
Approximability & Sums of Squares Ryan O’Donnell Carnegie Mellon.
Gillat Kol joint work with Ran Raz Locally Testable Codes Analogues to the Unique Games Conjecture Do Not Exist.
Dana Moshkovitz MIT Joint work with Subhash Khot, NYU 1.
The Max-Cut problem: Election recounts? Majority vs. Electoral College? 7812.
On the Unique Games Conjecture Subhash Khot Georgia Inst. Of Technology. At FOCS 2005.
Hardness of Robust Graph Isomorphism, Lasserre Gaps, and Asymmetry of Random Graphs Ryan O’Donnell (CMU) John Wright (CMU) Chenggang Wu (Tsinghua) Yuan.
Generalization and Specialization of Kernelization Daniel Lokshtanov.
Inapproximability Seminar – 2005 David Arnon  March 3, 2005 Some Optimal Inapproximability Results Johan Håstad Royal Institute of Technology, Sweden.
Gillat Kol joint work with Irit Dinur Covering CSPs.
MaxClique Inapproximability Seminar on HARDNESS OF APPROXIMATION PROBLEMS by Dr. Irit Dinur Presented by Rica Gonen.
Kevin Matulef MIT Ryan O’Donnell CMU Ronitt Rubinfeld MIT Rocco Servedio Columbia.
Constraint Satisfaction over a Non-Boolean Domain Approximation Algorithms and Unique Games Hardness Venkatesan Guruswami Prasad Raghavendra University.
Probabilistically Checkable Proofs (and inapproximability) Irit Dinur, Weizmann open day, May 1 st 2009.
Introduction to PCP and Hardness of Approximation Dana Moshkovitz Princeton University and The Institute for Advanced Study 1.
1/17 Optimal Long Test with One Free Bit Nikhil Bansal (IBM) Subhash Khot (NYU)
Dictator tests and Hardness of approximating Max-Cut-Gain Ryan O’Donnell Carnegie Mellon (includes joint work with Subhash Khot of Georgia Tech)
Analysis of Boolean Functions Fourier Analysis, Projections, Influence, Junta, Etc… And (some) applications Slides prepared with help of Ricky Rosen.
1 Optimization problems such as MAXSAT, MIN NODE COVER, MAX INDEPENDENT SET, MAX CLIQUE, MIN SET COVER, TSP, KNAPSACK, BINPACKING do not have a polynomial.
Vol.1: Geometry Subhash Khot IAS Elchanan Mossel UC Berkeley Guy Kindler DIMACS Ryan O’Donnell IAS.
Ryan O'Donnell (CMU, IAS) Yi Wu (CMU, IBM) Yuan Zhou (CMU)
Fourier Analysis of Boolean Functions Juntas, Projections, Influences Etc.
1 Slides by Asaf Shapira & Michael Lewin & Boaz Klartag & Oded Schwartz. Adapted from things beyond us.
Ryan ’Donnell Carnegie Mellon University O. Ryan ’Donnell Carnegie Mellon University.
1 Hardness Result for MAX-3SAT This lecture is given by: Limor Ben Efraim.
Dana Moshkovitz, MIT Joint work with Subhash Khot, NYU.
Correlation testing for affine invariant properties on Shachar Lovett Institute for Advanced Study Joint with Hamed Hatami (McGill)
Ryan O’Donnell Carnegie Mellon University. Part 1: A. Fourier expansion basics B. Concepts: Bias, Influences, Noise Sensitivity C. Kalai’s proof of Arrow’s.
Sub-Constant Error Low Degree Test of Almost-Linear Size Dana Moshkovitz Weizmann Institute Ran Raz Weizmann Institute.
Ryan ’Donnell Carnegie Mellon University O. f : {−1, 1} n → {−1, 1} is “quasirandom” iff fixing O(1) input coords changes E[f(x)] by only o (1)
Primer on Fourier Analysis Dana Moshkovitz Princeton University and The Institute for Advanced Study.
1/19 Minimizing weighted completion time with precedence constraints Nikhil Bansal (IBM) Subhash Khot (NYU)
Unique Games Approximation Amit Weinstein Complexity Seminar, Fall 2006 Based on: “Near Optimal Algorithms for Unique Games" by M. Charikar, K. Makarychev,
CS6045: Advanced Algorithms NP Completeness. NP-Completeness Some problems are intractable: as they grow large, we are unable to solve them in reasonable.
Why almost all satisfiable k - CNF formulas are easy? Danny Vilenchik Joint work with A. Coja-Oghlan and M. Krivelevich.
Analysis of Boolean Functions and Complexity Theory Economics Combinatorics …
Non Linear Invariance Principles with Applications Elchanan Mossel U.C. Berkeley
TU/e Algorithms (2IL15) – Lecture 11 1 Approximation Algorithms.
P & NP.
Gil Kalai Einstein Institute of Mathematics
Sum of Squares, Planted Clique, and Pseudo-Calibration
Possibilities and Limitations in Computation
NP-Completeness Yin Tat Lee
Noise stability of functions with low influences:
Subhash Khot Dept of Computer Science NYU-Courant & Georgia Tech
Subhash Khot Theory Group
Linear sketching with parities
Venkatesan Guruswami Yuan Zhou (Carnegie Mellon University)
Linear sketching over
Introduction to PCP and Hardness of Approximation
Linear sketching with parities
NP-Completeness Yin Tat Lee
Complexity Theory in Practice
Sparse Kindler-Safra Theorem via agreement theorems
Small Set Expansion in The Johnson Graph
Presentation transcript:

Subhash Khot IAS Elchanan Mossel UC Berkeley Guy Kindler DIMACS Ryan O’Donnell IAS

Our main theorem Unique Games Conjecture + Majority Is Stablest Conjecture  It is NP-hard to approximate MAX-CUT to within any factor better than α GW =.878…

Conjectures? What? Usual modus operandi in Mathematics: Prove theorem, give talk. Non-usual modus operandi in Mathematics: Fail to prove two theorems, give talk.

Why this is still interesting Part 1: The status of the conjectures

Unique Games conjecture [Khot ’02]: A certain graph-coloring problem is NP-hard. A simple way to think about it: MAX-2LIN(m) Input: Some two-variable linear equations mod m=10⁶, over n variables. You are promised that there is an assignment satisfying 99% of them. Goal: Find an assignment satisfying 1% of them. Status of UGC: ???. It would be a pity if it were false.

Majority Is Stablest conjecture Roughly speaking: among all boolean functions in which each coordinate has “small influence,” the Majority function is least susceptible to noise in the input. Status of MISC: Almost certainly true, we claim. Preponderance of published evidence supports it Preponderance of expert opinion supports it We have some partial results

“Beating Goemans-Williamson – i.e., approximating MAX-CUT to a factor.879 – is formally harder* than the problem of satisfying 1% of a given set of 99%-satisfiable two-variable linear equations mod 10⁶.” So, Uri Zwick et al, please work on this problem, rather than this problem. How we want you to interpret our result

Why this is still interesting Part 2: More justification

More justification Natural, simple problem; no progress made on it in years. Seemed as though there ought to be plenty of room for improving the GW algorithm. α GW is a funny number. Insight into the Unique Games Conjecture. Fourier methods and results independently interesting. Motivates algorithmic progress on other 2-variable CSPs: MAX-2SAT, MAX-2LIN(m), …

Plan for the talk: 1. Describe the Unique Games Conjecture. 2. State the Majority Is Stablest Conjecture. 3. Sketch proof of main theorem. 4.Evidence for Majority Is Stablest Conjecture. 5.Conclusions and open problems

Plan for the talk: 1. Describe the Unique Games Conjecture. 2. State the Majority Is Stablest Conjecture. 3. Sketch proof of main theorem. 4.Evidence for Majority Is Stablest Conjecture. 5.Conclusions and open problems

Unique Games Conjecture “Unique Label Cover” with m colors: n Labels [m] π uv π uv : Bijections Input π uv

Unique Games Conjecture “Unique Label Cover” with m colors: n Labels [m] π uv π uv : Bijections Solution π uv

Unique Games Conjecture Unique Games Conjecture [Khot ’02]: “For every constant ε > 0, there exists a constant m = m(ε) such that it is NP-hard to distinguish between (1−ε)-satisfiable and ε-satisfiable instances of Unique Label Cover with m labels.”

Unique Games Conjecture A strengthening of the PCP Theorem of AS+ALMSS+Raz Implies hardness of MAX-2LIN(m). Implies MIN-2SAT-Deletion hard to approximate to within any constant factor [Khot ’02, Håstad], Vertex-Cover hard to approximate to within any factor smaller than 2 [Khot-Regev ’03] These results need an appropriate “Inner Verifier” – correctness follows from deep theorem in Fourier analysis. [Bourgain ’02; Friedgut ’98]

Plan for the talk: 1. Describe the Unique Games Conjecture. 2. State the Majority Is Stablest Conjecture. 3. Sketch proof of main theorem. 4.Discuss the Majority Is Stablest Conjecture. 5.Conclusions and open problems

Majority Is Stablest Conjecture Introduced formally by us in the present work. A related conjecture was made in [G. Kalai ’02], a paper about “Social Choice” theory from economics. Folkloric inklings of it have existed for a while. [Ben-Or-Linial ‘90, Benjamini-Kalai-Schramm ’98, Mossel-O. ’02, Bourgain ’02] To state it, a few definitions are needed.

Influences on boolean functions Let f : {−1,1}ⁿ  {−1,1} be a boolean function. We view {−1,1}ⁿ as a probability space, uniform distribution. Def: Let i  [n]. Pick x at random and let y be x with the ith bit flipped. The influence of i on f is Inf i ( f ) = Pr [ f(x) ≠ f(y) ].

Influence examples Let f be the Dictator function, f (x) = x 1. Inf 1 ( f ) = 1,Inf i ( f ) = 0 for all i ≠ 1. Let f be the Parity function on n bits. Inf i ( f ) = 1for all i. Let f be the Majority function on n bits. Inf i ( f ) = + o(1) for all i. √n √n √2/π

Noise sensitivity Let −1 < ρ < 1. Given a string x, “applying ρ-noise” means: Pick y at random by choosing each coord. independently and w.p. s.t. E[x i y i ] = ρ. (Hence E[  x, y  ] = ρn.) For ρ > 0, this means for each bit of x, leave it alone w.p. ρ, replace it with a random bit w.p. 1−ρ. [For ρ < 0, first set x = −x, ρ = −ρ, then do the above.] Def: The noise sensitivity of f at ρ is NS ρ ( f ) = Pr [ f(x) ≠ f(y) ].

Noise sensitivity examples Let f be the Dictator function. NS ρ ( f ) = ½ − ½ ρ. Let f be the Parity function on n bits. NS ρ ( f ) = ½ − ½ ρⁿ. Let f be the Majority function on n bits. NS ρ ( f ) = (arccos ρ)/π ± o(1). [Central Lim. Th.]

NS ρ ( Dict ) = ½ − ½ ρ ½ NS 1 10 ρ −1 NS ρ ( Maj ) = (arccos ρ)/π −.69 = : ρ* 87.8%

Majority Is Stablest Conjecture Conjecture: “Fix 0 < ρ < 1. Let f : {−1,1}ⁿ  {−1,1} be any boolean function* satisfying f is balanced: E[ f ] = 0; f has small influences:Inf i ( f ) < δ for all i. Then NS ρ ( f ) ≥ (arccos ρ)/π − o δ (1).”

Plan for the talk: 1. Describe the Unique Games Conjecture. 2. State the Majority Is Stablest Conjecture. 3. Sketch proof of main theorem. 4.Evidence for Majority Is Stablest Conjecture. 5.Conclusions and open problems

Sketch of the main theorem The main theorem gives a (poly-time) reduction from Unique Label Cover to Gap-MAX-CUT. The reduction is parameterized by − 1 < ρ < 1. (1−ε)-satisfiable ULC instances MAP TO: weighted graphs with cuts of weight ½ − ½ ρ − o ε (1) ε-satisfiable ULC instances MAP TO: weighted graphs with no cuts more than (arccos ρ)/π + o ε (1) We choose our favorite ρ, viz. ρ*, and then MAX-CUT hardness is ratio of second quantity to first quantity.

Sketch of the main theorem

{−1,1} m (1,1,1)(1,1, − 1)( − 1, − 1, − 1) · · ·

Sketch of the main theorem π uv fvfv fvfv fvfv fvfv fvfv fvfv fvfv fvfv fvfv fvfv

Plan for the talk: 1. Describe the Unique Games Conjecture. 2. State the Majority Is Stablest Conjecture. 3.Sketch proof of main theorem. 4. Evidence for Majority Is Stablest Conjecture. 5. Conclusions and open problems.

Noise stability In working on the Majority Is Stablest Conjecture it is more convenient to work with a linear fcn. of noise sensitivity. Def: The stability of f at ρ is S ρ ( f ) = 1 − 2 NS ρ ( f ). Note: S ρ ( f ) = 1 − 2 Pr [ f(x) ≠ f(y) ] = 1 − 2 E[ ½ − ½ f(x) f(y) ] = E[ f(x) f(y) ].

S ρ ( Dict ) = ρ − 1 S ρ S ρ ( Maj ) = (2/π) arcsin ρ

Evidence for Maj. Is Stablest Note that Majority is “Uniformly Stable” – for fixed ρ, as n  ∞, S ρ ( Majority n ) is bounded away from 0. On the other hand, Parity is “Asymptotically Sensitive” – for fixed ρ, as n  ∞, S ρ ( Parity n ) = ρⁿ  0. The family of all boolean halfspaces – functions of the form sign(a 1 x 1 + · · · + a n x n ) – are Uniformly Stable ([BKS ’98, Peres ’98]), and in fact more is true…

Evidence for Maj. Is Stablest [BKS ’98] shows that the set of boolean halfspaces “asymptotically span” the Uniformly Stable functions: Uniformly Stable families of functions have Ω(1) correlation with the family of boolean halfspaces (monotone) function families are Asymptotically Sensitive iff they are asymptotically orthogonal to the set of boolean halfspaces Theorem [us]: The Majority Is Stablest Conjecture is true when restricted to the set of boolean halfspaces.

g(x) = Σ c S · Π x i Fourier detour Any g : {−1,1}ⁿ  R can be expressed as a multilinear polynomial: Def: For 0 ≤ k ≤ n, the weight of g at level k is w(k) = Σ ĝ(S)² g(x) = Σ ĝ(S) · Π x i S  [n]i  S |S| = k

Fourier facts if g : {−1,1}ⁿ  [−1,1], Σ k w(k) ≤ 1 (equality if  {−1,1}) if g is balanced (E[g] = 0), then w(0) = 0 Inf i ( g ) = Σ ĝ(S)² S ρ ( g ) = Σ k w(k) · ρ k “The more g’s weight is at lower levels, the stabler g is.” S  i

Maj. Is Stablest evidence Conjecture [Kalai ’02]: The “symmetric” boolean-valued function [“symmetric” implies small influences] with most weight on levels 1… k is Majority. Thm [Bourgain ’02]: Boolean-valued functions with small influences have at least as much weight beyond level k as Majority (asymptotically). Thm [us]: Bounded functions with small influences have no more weight at level 1 than 2/π, precisely the weight of Majority at level 1.

Corollary of our level-1 result Weakened version of Majority Is Stablest Conjecture: Thm: If f : {−1,1}ⁿ  [−1,1] has small influences and ρ < 0, NS ρ ( f ) ≥ ½ − ρ/π − (½ − 1/π)ρ³ − o(1).

½ NS 1 10 ρ −1 −½ = : ρ* ¾ + 1 / 2π

Corollary of our level-1 result Weakened version of Majority Is Stablest Conjecture: Thm: If f : {−1,1}ⁿ  [−1,1] has small influences and ρ < 0, NS ρ ( f ) ≥ ½ − ρ/π − (½ − 1/π)ρ³ − o(1). Cor: The Unique Games Conjecture implies it is NP-hard to approximate MAX-CUT to any factor larger than ¾ + 1 / 2π =.909… < 16/17 =.941…

Plan for the talk: 1. Describe the Unique Games Conjecture. 2. State the Majority Is Stablest Conjecture. 3.Sketch proof of main theorem. 4. Evidence for Majority Is Stablest Conjecture. 5. Conclusions and open problems.

Conclusions and open problems “Beating Goemans-Williamson is harder than cracking Unique Label Cover or MAX-2LIN(m).” Open problems: Prove Majority Is Stablest Conjecture. What balanced m-ary function f : [m]ⁿ  [m] is stablest? A conjecture: Plurality. Thm [us]: Noise stability of Plurality is m (ρ-1)/(ρ+1) + o(1).

Conclusions and open problems Connections between stability conjectures and Unique Games Conjecture: Proving that m-ary stability is o m (1) is probably enough to show that UGC implies hardness of (hence, essentially, equivalence with) MAX-2LIN(m). Proving a sharp bound for the m-ary stability problem would give strong results for the UGC w.r.t. how big m needs to be as a function of ε.