Umans Complexity Theory Lectures Lecture 1c: Robust Time & Space Classes.

Slides:



Advertisements
Similar presentations
1 Nondeterministic Space is Closed Under Complement Presented by Jing Zhang and Yingbo Wang Theory of Computation II Professor: Geoffrey Smith.
Advertisements

Lecture 16: Relativization Umans Complexity Theory Lecturess.
CS151 Complexity Theory Lecture 3 April 6, CS151 Lecture 32 Introduction A motivating question: Can computers replace mathematicians? L = { (x,
Fall 2013 CMU CS Computational Complexity Lecture 5 Savich’s theorem, and IS theorems. These slides are mostly a resequencing of Chris Umans’ slides.
Complexity class NP Is the class of languages that can be verified by a polynomial-time algorithm. L = { x in {0,1}* | there exists a certificate y with.
Umans Complexity Theory Lectures Lecture 4b: Nondeterministic Space: I-S Theorem: NL = coNL.
CSCI 4325 / 6339 Theory of Computation Zhixiang Chen.
Umans Complexity Theory Lectures Lecture 2a: Reductions & Completeness.
INHERENT LIMITATIONS OF COMPUTER PROGRAMS CSci 4011.
Complexity 13-1 Complexity Andrei Bulatov Hierarchy Theorem.
Measuring Time Complexity Sipser 7.1 (pages )
P and NP Sipser (pages ). CS 311 Fall Polynomial time P = ∪ k TIME(n k ) … P = ∪ k TIME(n k ) … TIME(n 3 ) TIME(n 2 ) TIME(n)
CS151 Complexity Theory Lecture 3 April 6, Nondeterminism: introduction A motivating question: Can computers replace mathematicians? L = { (x,
March 2, 2015CS21 Lecture 231 CS21 Decidability and Tractability Lecture 23 March 2, 2015.
CS21 Decidability and Tractability
Complexity ©D.Moshkovitz 1 Turing Machines. Complexity ©D.Moshkovitz 2 Motivation Our main goal in this course is to analyze problems and categorize them.
CS151 Complexity Theory Lecture 1 March 30, 2015.
FORMAL LANGUAGES, AUTOMATA AND COMPUTABILITY Read sections 7.1 – 7.3 of the book for next time.
CS151 Complexity Theory Lecture 12 May 6, CS151 Lecture 122 Outline The Polynomial-Time Hierarachy (PH) Complete problems for classes in PH, PSPACE.
Computability and Complexity 20-1 Computability and Complexity Andrei Bulatov Class NL.
CS151 Complexity Theory Lecture 2 April 3, Time and Space A motivating question: –Boolean formula with n nodes –evaluate using O(log n) space?
CS151 Complexity Theory Lecture 13 May 11, CS151 Lecture 132 Outline Natural complete problems for PH and PSPACE proof systems interactive proofs.
CS151 Complexity Theory Lecture 1 March 30, 2004.
Umans Complexity Theory Lectures Lecture 2c: EXP Complete Problem: Padding and succinctness.
February 20, 2015CS21 Lecture 191 CS21 Decidability and Tractability Lecture 19 February 20, 2015.
CS 310 – Fall 2006 Pacific University CS310 Complexity Section 7.1 November 27, 2006.
CS151 Complexity Theory Lecture 2 April 1, CS151 Lecture 22 Time and Space A motivating question: –Boolean formula with n nodes –evaluate using.
Theory of Computing Lecture 19 MAS 714 Hartmut Klauck.
CS 461 – Nov. 21 Sections 7.1 – 7.2 Measuring complexity Dividing decidable languages into complexity classes. Algorithm complexity depends on what kind.
Definition: Let M be a deterministic Turing Machine that halts on all inputs. Space Complexity of M is the function f:N  N, where f(n) is the maximum.
CSCI 4325 / 6339 Theory of Computation Zhixiang Chen.
חישוביות וסיבוכיות Computability and Complexity Lecture 7 TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A AAAA.
Theory of Computing Lecture 15 MAS 714 Hartmut Klauck.
February 18, 2015CS21 Lecture 181 CS21 Decidability and Tractability Lecture 18 February 18, 2015.
Theory of Computing Lecture 17 MAS 714 Hartmut Klauck.
Fall 2013 CMU CS Computational Complexity Lecture 3 and 4 Non-determinism, NTIME hierarchy threorem, Ladner’s Proof 9/17/2013.
Theory of Computing Lecture 21 MAS 714 Hartmut Klauck.
CS151 Complexity Theory Lecture 12 May 6, QSAT is PSPACE-complete Theorem: QSAT is PSPACE-complete. Proof: 8 x 1 9 x 2 8 x 3 … Qx n φ(x 1, x 2,
1 Design and Analysis of Algorithms Yoram Moses Lecture 11 June 3, 2010
Fall 2013 CMU CS Computational Complexity Lecture 7 Alternating Quantifiers, PH, PSPACE. These slides are mostly a resequencing of Chris Umans’
Hierarchy theorems Section 9.1 Giorgi Japaridze Theory of Computability.
Alternation Section 10.3 Giorgi Japaridze Theory of Computability.
Fall 2013 CMU CS Computational Complexity Lecture 2 Diagonalization, 9/12/2013.
CSCI 2670 Introduction to Theory of Computing December 2, 2004.
Umans Complexity Theory Lectures Lecture 1b: Turing Machines & Halting Problem.
Theory of Computational Complexity Yuji Ishikawa Avis lab. M1.
Chapter 7 Introduction to Computational Complexity.
Theory of Computational Complexity TA : Junichi Teruyama Iwama lab. D3
CSCI 2670 Introduction to Theory of Computing November 15, 2005.
 2005 SDU Lecture14 Mapping Reducibility, Complexity.
Umans Complexity Theory Lectures
Turing Machines Space bounds Reductions Complexity classes
Umans Complexity Theory Lectures
CS151 Complexity Theory Lecture 2 April 5, 2017.
Theory of Computational Complexity
Computability & Complexity I
CS21 Decidability and Tractability
CS151 Complexity Theory Lecture 3 April 10, 2017.
Theory of Computability
CS154, Lecture 12: Time Complexity
Part II Theory of Nondeterministic Computation
CS21 Decidability and Tractability
Umans Complexity Theory Lectures
CS21 Decidability and Tractability
Umans Complexity Theory Lectures
CS151 Complexity Theory Lecture 12 May 10, 2019.
CS151 Complexity Theory Lecture 1 April 2, 2019.
CS151 Complexity Theory Lecture 4 April 12, 2019.
Intro to Theory of Computation
CS151 Complexity Theory Lecture 4 April 8, 2004.
Presentation transcript:

Umans Complexity Theory Lectures Lecture 1c: Robust Time & Space Classes

2 Complexity Classes Back to complexity classes: –TIME(f(n)) = languages decidable by a multi- tape TM in at most f(n) steps, where n is the input length, and f :N → N –SPACE(f(n)) = languages decidable by a multi-tape TM that touches at most f(n) squares of its work tapes, where n is the input length, and f :N → N Note: P =  k >= 1 TIME(n k )

3 Proper Complexity Functions Definition: f is a proper complexity function if –f(n) ≥ f(n-1) for all n –there exists a TM M that outputs exactly f(n) symbols on input 1 n, and runs in time O(f(n) + n) and space O(f(n)).

4 Proper Complexity Functions includes all reasonable functions we will work with –log n, √n, n 2, 2 n, n!, … –if f and g are proper then f + g, fg, f(g), f g, 2 g are all proper can mostly ignore, but be aware it is a genuine concern: Theorem: ∃ non-proper f such that TIME(f(n)) = TIME(2 f(n) ).

5 Hierarchy Theorems Does genuinely more space permit us to decide new languages? Theorem (Space Hierarchy Theorem): For every proper complexity function f(n) ≥ log n: SPACE(f(n)) ⊊ SPACE(f(n) log f(n)). Proof: same ideas.

6 Robust Time and Space Classes What is meant by “robust” class? –no formal definition –reasonable changes to model of computation shouldn’t change class –should allow “modular composition” – calling subroutine in class (for classes closed under complement…)

7 Robust Time and Space Classes Robust time and space classes: L = SPACE(log n) PSPACE =  k SPACE(n k ) P =  k TIME(n k ) EXP =  k TIME(2 n k )

8 Time and Space Classes Problems in these classes:   101 L : FVAL, integer multiplication, most reductions… PSPACE : generalized geography, 2-person games… pasadena athens auckland san francisco oakland davis

9 Time and Space Classes P : CVAL, linear programming, max- flow…   10   101  EXP : SAT, all of NP and much more…

10 Relationships between classes How are these four classes related to each other? Time Hierarchy Theorem implies P ⊊ EXP –P ⊊ TIME(2 n ) ( TIME(2 (2n)3 ) ⊆ EXP Space Hierarchy Theorem implies L ⊊ PSPACE –L = SPACE(log n) ⊊ SPACE(log 2 n) ⊊ PSPACE

11 Relationships between classes Easy: P ⊆ PSPACE L vs. P, PSPACE vs. EXP ?

12 Relationships between classes Useful convention: Turing Machine configurations. Any point in computation represented by string: C = σ 1 σ 2 … σ i q σ i+1 σ i+2 … σ m start configuration for single-tape TM on input x: q start x 1 x 2 …x n σ1σ1... state = q σ2σ2 …σiσi σ i+1 …σmσm

13 Relationships between classes easy to tell if C yields C’ in 1 step configuration graph: nodes are configurations, edge (C, C’) iff C yields C’ in one step # configurations for a 2-tape TM (work tape + read-only input) that runs in space t(n) n x t(n) x |Q| x |∑| t(n) input-tape head position work-tape head position state work-tape contents

14 Relationships between classes if t(n) = c log n, at most n x (c log n) x c 0 x c 1 c log n ≤ n k configurations. can determine if reach q accept or q reject from start configuration by exploring config. graph of size n k (e.g. by DFS) Conclude: L ⊆ P

15 Relationships between classes if t(n) = n c, at most n x n c x c 0 x c 1 n c ≤ 2 n k configurations. can determine if reach q accept or q reject from start configuration by exploring config. graph of size 2 n k (e.g. by DFS) Conclude: PSPACE ⊆ EXP

16 Relationships between classes So far: L ⊆ P ⊆ PSPACE ⊆ EXP believe all containments strict know L ( PSPACE, P ( EXP even before any mention of NP, two major unsolved problems: L = P P = PSPACE ??

17 Summary nondeterministic time classes: NP, coNP, NEXP NTIME Hierarchy Theorem: NP ≠ NEXP major open questions: P = NP NP = coNP ??

18 Summary NP-“intermediate” problems (unless P = NP) –technique: delayed diagonalization unary languages not NP-complete (unless P = NP) –true for sparse languages as well (homework) complete problems: –circuit SAT is NP-complete –UNSAT is coNP-complete –succinct circuit SAT is NEXP-complete

19 Summary EXP PSPACE P L NEXP NP coNP coNEXP