On the Complexity of Search Problems George Pierrakos Mostly based on: On the Complexity of the Parity Argument and Other Insufficient Proofs of Existence.

Slides:



Advertisements
Similar presentations
Comparative Succinctness of KR Formalisms Paolo Liberatore.
Advertisements

6.896: Topics in Algorithmic Game Theory Lecture 8 Constantinos Daskalakis.
COMP 553: Algorithmic Game Theory Fall 2014 Yang Cai Lecture 21.
Computation of Nash Equilibrium Jugal Garg Georgios Piliouras.
Department of Computer Science & Engineering
NP-complete and NP-hard problems Transitivity of polynomial-time many-one reductions Concept of Completeness and hardness for a complexity class Definition.
Complexity class NP Is the class of languages that can be verified by a polynomial-time algorithm. L = { x in {0,1}* | there exists a certificate y with.
The Theory of NP-Completeness
Great Theoretical Ideas in Computer Science for Some.
Umans Complexity Theory Lectures Lecture 2a: Reductions & Completeness.
Having Proofs for Incorrectness
© The McGraw-Hill Companies, Inc., Chapter 8 The Theory of NP-Completeness.
On the Complexity of Search Problems George Pierrakos Mostly based on: On the Complexity of the Parity Argument and Other Insufficient Proofs of Existence.
COMP 553: Algorithmic Game Theory Fall 2014 Yang Cai Lecture 20.
CSC5160 Topics in Algorithms Tutorial 2 Introduction to NP-Complete Problems Feb Jerry Le
Computability and Complexity 13-1 Computability and Complexity Andrei Bulatov The Class NP.
CS21 Decidability and Tractability
Computability and Complexity 15-1 Computability and Complexity Andrei Bulatov NP-Completeness.
RELATIVIZATION CSE860 Vaishali Athale. Overview Introduction Idea behind “Relativization” Concept of “Oracle” Review of Diagonalization Proof Limits of.
1 CSE 417: Algorithms and Computational Complexity Winter 2001 Lecture 23 Instructor: Paul Beame.
Analysis of Algorithms CS 477/677
Last class Decision/Optimization 3-SAT  Independent-Set Independent-Set  3-SAT P, NP Cook’s Theorem NP-hard, NP-complete 3-SAT  Clique, Subset-Sum,
NP-complete examples CSC3130 Tutorial 11 Xiao Linfu Department of Computer Science & Engineering Fall 2009.
CS Master – Introduction to the Theory of Computation Jan Maluszynski - HT Lecture NP-Completeness Jan Maluszynski, IDA, 2007
Toward NP-Completeness: Introduction Almost all the algorithms we studies so far were bounded by some polynomial in the size of the input, so we call them.
1 CSE 417: Algorithms and Computational Complexity Winter 2001 Lecture 22 Instructor: Paul Beame.
The Computational Complexity of Finding a Nash Equilibrium Edith Elkind, U. of Warwick.
INHERENT LIMITATIONS OF COMPUTER PROGRAMS CSci 4011.
6.896: Topics in Algorithmic Game Theory Lecture 7 Constantinos Daskalakis.
The Theory of NP-Completeness 1. Nondeterministic algorithms A nondeterminstic algorithm consists of phase 1: guessing phase 2: checking If the checking.
The Theory of NP-Completeness 1. What is NP-completeness? Consider the circuit satisfiability problem Difficult to answer the decision problem in polynomial.
1 The Theory of NP-Completeness 2012/11/6 P: the class of problems which can be solved by a deterministic polynomial algorithm. NP : the class of decision.
The Computational Complexity of Finding Nash Equilibria Edith Elkind Intelligence, Agents, Multimedia group (IAM) School of Electronics and CS U. of Southampton.
February 18, 2015CS21 Lecture 181 CS21 Decidability and Tractability Lecture 18 February 18, 2015.
The Complexity of Optimization Problems. Summary -Complexity of algorithms and problems -Complexity classes: P and NP -Reducibility -Karp reducibility.
Computational Complexity Theory Lecture 2: Reductions, NP-completeness, Cook-Levin theorem Indian Institute of Science.
Theory of Computing Lecture 17 MAS 714 Hartmut Klauck.
1 NP-Completeness Poly time algorithm: input size n (in some encoding), worst case running time – O(n c ) for some constant c. Three classes of problems.
Cs3102: Theory of Computation Class 24: NP-Completeness Spring 2010 University of Virginia David Evans.
CSCI 2670 Introduction to Theory of Computing November 29, 2005.
CSCI 2670 Introduction to Theory of Computing December 1, 2004.
CSCI 3160 Design and Analysis of Algorithms Tutorial 10 Chengyu Lin.
1 The Theory of NP-Completeness 2 Cook ’ s Theorem (1971) Prof. Cook Toronto U. Receiving Turing Award (1982) Discussing difficult problems: worst case.
1 Design and Analysis of Algorithms Yoram Moses Lecture 11 June 3, 2010
Ásbjörn H Kristbjörnsson1 The complexity of Finding Nash Equilibria Ásbjörn H Kristbjörnsson Algorithms, Logic and Complexity.
1. 2 Lecture outline Basic definitions: Basic definitions: P, NP complexity classes P, NP complexity classes the notion of a certificate. the notion of.
PhD Projects Rahul Santhanam University of Edinburgh.
NP-completeness Section 7.4 Giorgi Japaridze Theory of Computability.
Additional Classes: co-NP class Krishna Mahesh Deevela Murali.
Lecture 25 NP Class. P = ? NP = ? PSPACE They are central problems in computational complexity.
6.853: Topics in Algorithmic Game Theory Fall 2011 Constantinos Daskalakis Lecture 8.
Introduction to NP-Completeness Tahir Azim. The Downside of Computers Many problems can be solved in linear time or polynomial time But there are also.
CSCI 2670 Introduction to Theory of Computing December 2, 2004.
CSCI 2670 Introduction to Theory of Computing December 7, 2005.
April 13 th Class Notes Hw# 5 will be worth 50 points and it will be posted tonight or tomorrow.
The Theory of NP-Completeness 1. Nondeterministic algorithms A nondeterminstic algorithm consists of phase 1: guessing phase 2: checking If the checking.
6.853: Topics in Algorithmic Game Theory Fall 2011 Constantinos Daskalakis Lecture 9.
COMPLEXITY. Satisfiability(SAT) problem Conjunctive normal form(CNF): Let S be a Boolean expression in CNF. That is, S is the product(and) of several.
1 The Theory of NP-Completeness 2 Review: Finding lower bound by problem transformation Problem X reduces to problem Y (X  Y ) iff X can be solved by.
P & NP.
COMP/MATH 553: Algorithmic Game Theory
On the Complexity of Buffer Allocation in Message Passing Systems
NP-Completeness Yin Tat Lee
Intro to Theory of Computation
CSC 4170 Theory of Computation The class NP Section 7.3.
Umans Complexity Theory Lectures
Computing a Nash Equilibrium of a Congestion Game: PLS-completeness
Instructor: Aaron Roth
Instructor: Aaron Roth
Instructor: Aaron Roth
Presentation transcript:

On the Complexity of Search Problems George Pierrakos Mostly based on: On the Complexity of the Parity Argument and Other Insufficient Proofs of Existence [Pap94] On total functions, existence theorems and computational complexity [MP91] How easy is local search? [JPY88] Computational Complexity [Pap92] The complexity of computing a Nash equilibrium [DGP06] The complexity of pure Nash equilibria [FPT04] slides and scribe notes from many people… 1 TFNP and LeafCovering

Outline 1. Generally on Search Problems 2. The Class TFNP 3. Subclasses of TFNP part I: PPA, PPAD Problems in PPA, PPAD Completeness in PPAD 4. Subclasses of TFNP part II: PPP, PLS 5. PPAD-completeness of NASH & the complexity of computing equilibria in congestion games 2TFNP and LeafCovering

Outline 1. Generally on Search Problems 2. The Class TFNP 3. Subclasses of TFNP part I: PPA, PPAD Problems in PPA, PPAD Completeness in PPAD 4. Subclasses of TFNP part II: PPP, PLS 5. PPAD-completeness of NASH & the complexity of computing equilibria in congestion games 3TFNP and LeafCovering

Decision Problems vs Search (or “function”) Problems SAT Input: boolean CNF-formula φ Output: “yes” or “no” FSAT Input: boolean CNF-formula φ Output: satisfying assignment or “no” if none exist 4TFNP and LeafCovering

Are search problems harder? They are definitely not easier: a poly-time algorithm for FSAT can be easily tweaked to give a poly-time algorithm for SAT …and vice versa, FSAT “reduces” to SAT: we can figure out a satisfying assignment by running poly-time algorithm for SAT n-times 5TFNP and LeafCovering

The Classes FP and FNP L € NP iff there exists poly-time computable R L (x,y) s.t. X € L  y { |y| ≤ p(|x|) & R L (x,y) } Note how R L defines the problem-language L The corresponding search problem Π R(L) € FNP is: given an x find any y s.t. R L (x,y) and reply “no” if none exist FSAT € FNP… what about FTSP? Are all FNP problems self-reducible like FSAT? [open?] FP is the subclass of FNP where we only consider problems for which a poly-time algorithm is known 6TFNP and LeafCovering

Reductions and completeness A function problem Π R reduces to a function problem Π S if there exist log-space computable string functions f and g, s.t. R(x,g(y))  S(f(x),y) intuitively f reduces problem Π R to Π S and g transforms a solution of Π S to one of Π R Standard notion of completeness works fine… 7TFNP and LeafCovering

FP FNP A proof a-la-Cook shows that FSAT is FNP-complete Hence, if FSAT € FP then FNP = FP But we showed self-reducibility for SAT, so the theorem follows: Theorem: FP = FNP iff P=NP So, why care for function problems anyway?? 8TFNP and LeafCovering

Outline 1. Generally on Search Problems 2. The Class TFNP 3. Subclasses of TFNP part I: PPA, PPAD Problems in PPA, PPAD Completeness in PPAD 4. Subclasses of TFNP part II: PPP, PLS 5. PPAD-completeness of NASH & the complexity of computing equilibria in congestion games 9TFNP and LeafCovering

On total “functions”: the class TFNP What happens if the relation R is total? i.e., for each x there is at least one y s.t. R(x,y) Define TFNP to be the subclass of FNP where the relation R is total TFNP contains problems that always have a solution, e.g. factoring, fix-point theorems, graph-theoretic problems, … How do we know a solution exists? By an “inefficient proof of existence”, i.e. non-(efficiently)- constructive proof The idea is to categorize the problems in TFNP based on the type of inefficient argument that guarantees their solution 10TFNP and LeafCovering

Basic stuff about TFNP 1. FP TFNP FNP 2. TFNP = F(NP coNP) NP = problems with “yes” certificate y s.t. R 1 (x,y) coNP = problems with “no” certificate z s.t. R 2 (x,y) for TFNP F(NP coNP) take R = R 1 U R 2 for F(NP coNP) TFNP take R 1 = R and R 2 = ø 3. There is an FNP-complete problem in TFNP iff NP = coNP  : If NP = coNP then trivially FNP = TFNP  : If the FNP-complete problem Π R is in TFNP then: FSAT reduces to Π R via f and g, hence any unsatisfiable formula φ has a “no” certificate y, s.t. R(f(φ),y) (y exists since Π R is in TFNP) and g(y)=“no” 4. TFNP is a semantic complexity class  no complete problems! note how telling whether a relation is total is undecidable (and not even RE!!) 11TFNP and LeafCovering