Ryan ’Donnell Carnegie Mellon University O. Ryan ’Donnell Carnegie Mellon University.

Slides:



Advertisements
Similar presentations
Hardness of Reconstructing Multivariate Polynomials. Parikshit Gopalan U. Washington Parikshit Gopalan U. Washington Subhash Khot NYU/Gatech Rishi Saket.
Advertisements

Linear-Degree Extractors and the Inapproximability of Max Clique and Chromatic Number David Zuckerman University of Texas at Austin.
Ryan Donnell Carnegie Mellon University O. 1. Describe some TCS results requiring variants of the Central Limit Theorem. Talk Outline 2. Show a flexible.
How to Round Any CSP Prasad Raghavendra University of Washington, Seattle David Steurer, Princeton University (In Principle)
Subhash Khot IAS Elchanan Mossel UC Berkeley Guy Kindler DIMACS Ryan O’Donnell IAS.
Inapproximability of MAX-CUT Khot,Kindler,Mossel and O ’ Donnell Moshe Ben Nehemia June 05.
Dana Moshkovitz MIT Joint work with Subhash Khot, NYU 1.
The Max-Cut problem: Election recounts? Majority vs. Electoral College? 7812.
On the Unique Games Conjecture Subhash Khot Georgia Inst. Of Technology. At FOCS 2005.
Hardness of Robust Graph Isomorphism, Lasserre Gaps, and Asymmetry of Random Graphs Ryan O’Donnell (CMU) John Wright (CMU) Chenggang Wu (Tsinghua) Yuan.
Inapproximability Seminar – 2005 David Arnon  March 3, 2005 Some Optimal Inapproximability Results Johan Håstad Royal Institute of Technology, Sweden.
Ryan O’Donnell Carnegie Mellon University analysisofbooleanfunctions.org.
MaxClique Inapproximability Seminar on HARDNESS OF APPROXIMATION PROBLEMS by Dr. Irit Dinur Presented by Rica Gonen.
Ryan O’Donnell & Yi Wu Carnegie Mellon University (aka, Conditional hardness for satisfiable 3-CSPs)
Ryan ’Donnell Carnegie Mellon University Institute for Advanced Study O.
Kevin Matulef MIT Ryan O’Donnell CMU Ronitt Rubinfeld MIT Rocco Servedio Columbia.
Constraint Satisfaction over a Non-Boolean Domain Approximation Algorithms and Unique Games Hardness Venkatesan Guruswami Prasad Raghavendra University.
3-Query Dictator Testing Ryan O’Donnell Carnegie Mellon University joint work with Yi Wu TexPoint fonts used in EMF. Read the TexPoint manual before you.
Subhash Khot Georgia Tech Ryan O’Donnell Carnegie Mellon SDP Gaps and UGC-Hardness for Max-Cut-Gain &
Conditional Inapproximability and Limited Independence
Probabilistically Checkable Proofs (and inapproximability) Irit Dinur, Weizmann open day, May 1 st 2009.
Introduction to PCP and Hardness of Approximation Dana Moshkovitz Princeton University and The Institute for Advanced Study 1.
A 3-Query PCP over integers a.k.a Solving Sparse Linear Systems Prasad Raghavendra Venkatesan Guruswami.
1/17 Optimal Long Test with One Free Bit Nikhil Bansal (IBM) Subhash Khot (NYU)
Gillat Kol joint work with Ran Raz Locally Testable Codes Analogues to the Unique Games Conjecture Do Not Exist.
Inapproximability from different hardness assumptions Prahladh Harsha TIFR 2011 School on Approximability.
Two Query PCP with Sub-constant Error Dana Moshkovitz Princeton University Ran Raz Weizmann Institute 1.
Dictator tests and Hardness of approximating Max-Cut-Gain Ryan O’Donnell Carnegie Mellon (includes joint work with Subhash Khot of Georgia Tech)
Approximation Algoirthms: Semidefinite Programming Lecture 19: Mar 22.
Venkatesan Guruswami (CMU) Yuan Zhou (CMU). Satisfiable CSPs Theorem [Schaefer'78] Only three nontrivial Boolean CSPs for which satisfiability is poly-time.
Semidefinite Programming
On the Unique Games Conjecture Subhash Khot NYU Courant CCC, June 10, 2010.
Vol.1: Geometry Subhash Khot IAS Elchanan Mossel UC Berkeley Guy Kindler DIMACS Ryan O’Donnell IAS.
Ryan O'Donnell (CMU, IAS) Yi Wu (CMU, IBM) Yuan Zhou (CMU)
It’s all about the support: a new perspective on the satisfiability problem Danny Vilenchik.
Semidefinite Programming Based Approximation Algorithms Uri Zwick Uri Zwick Tel Aviv University UKCRC’02, Warwick University, May 3, 2002.
Last class Decision/Optimization 3-SAT  Independent-Set Independent-Set  3-SAT P, NP Cook’s Theorem NP-hard, NP-complete 3-SAT  Clique, Subset-Sum,
Finding Almost-Perfect
Dana Moshkovitz, MIT Joint work with Subhash Khot, NYU.
Randomness – A computational complexity view Avi Wigderson Institute for Advanced Study.
Subhash Khot’s work and its impact Sanjeev Arora Computer Science Dept, Princeton University ICM 2014 Nevanlinna Prize Laudatio.
Correlation testing for affine invariant properties on Shachar Lovett Institute for Advanced Study Joint with Hamed Hatami (McGill)
Ryan O’Donnell Carnegie Mellon University. Part 1: A. Fourier expansion basics B. Concepts: Bias, Influences, Noise Sensitivity C. Kalai’s proof of Arrow’s.
Ryan ’Donnell Carnegie Mellon University O. f : {−1, 1} n → {−1, 1} is “quasirandom” iff fixing O(1) input coords changes E[f(x)] by only o (1)
Primer on Fourier Analysis Dana Moshkovitz Princeton University and The Institute for Advanced Study.
Yuan Zhou Carnegie Mellon University Joint works with Boaz Barak, Fernando G.S.L. Brandão, Aram W. Harrow, Jonathan Kelner, Ryan O'Donnell and David Steurer.
Semidefinite Programming
1/19 Minimizing weighted completion time with precedence constraints Nikhil Bansal (IBM) Subhash Khot (NYU)
Sarah R. Allen Ryan O’Donnell David Witmer Carnegie Mellon University.
Shorter Long Codes and Applications to Unique Games 1 Boaz Barak (MSR, New England) Parikshit Gopalan (MSR, SVC) Johan Håstad (KTH) Prasad Raghavendra.
C&O 355 Lecture 24 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A A A A A A A A.
Unique Games Approximation Amit Weinstein Complexity Seminar, Fall 2006 Based on: “Near Optimal Algorithms for Unique Games" by M. Charikar, K. Makarychev,
Prasad Raghavendra Georgia Institute of Technology, Atlanta, GA Complexity of Constraint Satisfaction Problems Exact and Approximate TexPoint fonts used.
Yuan Zhou, Ryan O’Donnell Carnegie Mellon University.
Dan Boneh Intro. Number Theory Fermat and Euler Online Cryptography Course Dan Boneh.
Why almost all satisfiable k - CNF formulas are easy? Danny Vilenchik Joint work with A. Coja-Oghlan and M. Krivelevich.
Yuan Zhou Carnegie Mellon University Joint works with Boaz Barak, Fernando G.S.L. Brandão, Aram W. Harrow, Jonathan Kelner, Ryan O'Donnell and David Steurer.
Non Linear Invariance Principles with Applications Elchanan Mossel U.C. Berkeley
Finding Almost-Perfect
Possibilities and Limitations in Computation
Noise stability of functions with low influences:
Subhash Khot Dept of Computer Science NYU-Courant & Georgia Tech
Subhash Khot Theory Group
Linear sketching with parities
Venkatesan Guruswami Yuan Zhou (Carnegie Mellon University)
Linear sketching over
Introduction to PCP and Hardness of Approximation
Linear sketching with parities
Small Set Expansion in The Johnson Graph
Presentation transcript:

Ryan ’Donnell Carnegie Mellon University O

Ryan ’Donnell Carnegie Mellon University

Part 1: Inverse Theorems Part 2: Inapproximability Part 3: The connection

Inverse Theorem for Linearity

Fourier Analysis

Inverse Theorem for Linearity

“High-end inverse theorem”: Pr [.. ] ≥ 1− ⇒ f is (1−2)-correlated with some χ ξ “Low-end inverse theorem”: Pr [.. ] ≥ + ⇒ f is 2-correlated with some χ ξ

X Y Z = uniform on ,,,

X Y Z ,,, [Håstad’97] = draw from w.p. 1−δ unif. on all 8 w.p. δ

[Håstad’97] |ξ| = # nonzero coords in ξ e.g.: ξ = (1,0,1,0,0,…,0,1), 〈 ξ, x 〉 = x 1 +x 3 +x n, |ξ| = 3

Håstad’s low-end inverse theorem: Pr [.. ] ≥ + η ⇒ f is 2η-correlated with some sparse χ ξ

Inverse Thm: If f has o(1) correlation w/ every O(1)-sparse χ ξ [Håstad’97] then p < + o(1). (besides ξ ≠ 0) “f is quasirandom”

Inverse Thm: If f has o(1) correlation w/ every O(1)-sparse χ ξ [Håstad’97] then p < + o(1). -Verse Thm: If f = χ ξ with |ξ| = 1 then p ≥ 1 − o(1).

Problem: 3-Sat Input: I = Alg’s goal: an assignment satisfying as many constraints as possible. 3-OR

Algorithm must be “ efficient ” # steps ≤ n O(1)

For input I, Opt( I ) = fraction of constraints satisfied by best asgnmt and with algorithm “Alg”, Alg( I ) = fraction of constraints satisfied by Alg’s asgnmt

Fact:There is no efficient algorithm for 3-OR with the following guarantee: if Opt( I ) = 1 then Alg( I ) = 1. * * unless P = NP.

Q: Can we have an efficient 3-OR alg. s.t. if Opt( I ) = 1 then Alg( I ) ≥ ? A: No. * The “PCP Theorem.” [Arora-Safra’92, Arora-Lund-Motwani-Sudan-Szegedy’92]

Q: Can we have an efficient 3-OR alg. s.t. if Opt( I ) = 1 then Alg( I ) ≥ ? A: No. * “Håstad’s 3-OR Inapproximability.” [Håstad’97]

Q: Can we have an efficient 3-OR alg. s.t. if Opt( I ) = 1 then Alg( I ) ≥ ? A: Yes we can. Choose a random asgnmt. [Johnson’74]

Problem: 3-XOR Input: I = overdetermined(?) linear sys. over with 3 vbls/eqn. 3-Lin (mod 2)

Q: Can we have an efficient 3-XOR alg. s.t. if Opt( I ) = 1 then Alg( I ) = 1 ? A: Yes. Gaussian Elimination.

Håstad’s 3-XOR Inapproximability Theorem: There is no * efficient 3-XOR alg. s.t. if Opt( I ) ≥ 1−δ then Alg( I ) ≥ +η. Remark: There is an efficient alg. with Alg( I ) ≥ always. Pick either x ≡ 0 or x ≡ 1.

Max-Cut

Problem: Max-Cut Input: I = (“2-≠”)

The Goemans-Williamson Algorithm: [GW’94] There is an efficient Max-Cut alg. s.t. ∀ ρ ≥.844, if Opt( I ) = ρ then Alg( I ) ≥ 1 1 ½.844

Max-Cut Inapproximability Theorem: There is no * * better efficient algorithm. [Khot-Kindler-Mossel-O’04, Mossel-O-Oleszkiewicz’05]

Inverse Thm: [Håstad’97] If f = χ ξ with |ξ| = 1 then p ≥ 1 − o(1). then p < + o(1). If f is quasirandom -Verse Thm:

then p < + o(1). If f is quasirandom If f = χ ξ with |ξ| = 1 then p ≥ 1 − o(1). Inverse Thm. Inapprox. There is no * efficient 3-XOR alg. s.t. if Opt( I ) ≥ 1 − o(1) then Alg( I ) ≥ + o(1).

then p < + o(1). If f is quasirandom If f = χ ξ with |ξ| = 1 then p = 1. Inverse Thm.

then p < + o(1). If f is quasirandom If f = χ ξ with |ξ| = 1 then p = 1. Inverse Thm. Inapprox. There is no * efficient 3-OR alg. s.t. if Opt( I ) = 1 then Alg( I ) ≥ + o(1).

then p < + o(1). If f is quasirandom If f = χ ξ with |ξ| = 1 then p = 1. Inverse Thm. Inapprox. There is no * efficient 3-OR alg. s.t. if Opt( I ) = 1 then Alg( I ) ≥ + o(1).

then p < + o(1). If f is quasirandom * If f = χ ξ with |ξ| = 1 then p = ρ. Inverse Thm. (sharp: f = Majority) “Majority Is Stablest” [Mossel-O-Oleszkiewicz’05]

then p < + o(1). If f is quasirandom * If f = χ ξ with |ξ| = 1 then p = ρ. Inverse Thm. Inapprox. There is no * * efficient Max-Cut (i.e., “ 2-≠ ”) alg. s.t. if Opt( I ) = ρ then Alg( I ) ≥ + o(1).

then p < + o(1). If f is quasirandom * If f = χ ξ with |ξ| = 1 then p = ρ. Inverse Thm. Inapprox. There is no * * efficient Max-Cut (i.e., “ 2-≠ ”) alg. s.t. if Opt( I ) = ρ then Alg( I ) ≥ + o(1). [one-semester course]

Ask me about… Invariance Principle [MOO’05, Mossel’08] (“CLT for quasirandom * polynomials”) Geometry of Gaussian Space [Borell’85] Unique Games Conjecture * * [Khot’02] Connections to Voting / Social Choice ( Influences [Banzhaf’65], Arrow’s Theorem [Kalai’02], Ain’t Over Till It’s Over Theorem [MOO’05] ) New inverse theorem & inapproximability for the 3-Any problem, 1 vs. ⅝ [O-Wu’09]