Complexity 1 The Padding Argument. Complexity 2 Motivation: Scaling-Up Complexity Claims space + non-determinism We have: space + determinism can be simulated.

Slides:



Advertisements
Similar presentations
COMPLEXITY THEORY CSci 5403 LECTURE VII: DIAGONALIZATION.
Advertisements

Part VI NP-Hardness. Lecture 23 Whats NP? Hard Problems.
1 Savitch and Immerman- Szelepcsènyi Theorems. 2 Space Compression  For every k-tape S(n) space bounded offline (with a separate read-only input tape)
1 Nondeterministic Space is Closed Under Complement Presented by Jing Zhang and Yingbo Wang Theory of Computation II Professor: Geoffrey Smith.
Complexity Theory Lecture 3 Lecturer: Moni Naor. Recap Last week: Non deterministic communication complexity Probabilistic communication complexity Their.
Lecture 24 Time and Space of NTM. Time For a NDM M and an input x, Time M (x) = the minimum # of moves leading to accepting x if x ε L(M) = infinity if.
Theoretical Foundation of Computation
Resource-Bounded Computation Previously: can it be done? Now: how efficiently can it be done? Goal: conserve computational resources: Time, space, other.
1 Space Complexity. 2 Def: Let M be a deterministic Turing Machine that halts on all inputs. Space Complexity of M is the function f:N  N, where f(n)
Giorgi Japaridze Theory of Computability Savitch’s Theorem Section 8.1.
Fall 2013 CMU CS Computational Complexity Lecture 5 Savich’s theorem, and IS theorems. These slides are mostly a resequencing of Chris Umans’ slides.
Umans Complexity Theory Lectures Lecture 4b: Nondeterministic Space: I-S Theorem: NL = coNL.
CSCI 4325 / 6339 Theory of Computation Zhixiang Chen.
INHERENT LIMITATIONS OF COMPUTER PROGRAMS CSci 4011.
Complexity 12-1 Complexity Andrei Bulatov Non-Deterministic Space.
Complexity 15-1 Complexity Andrei Bulatov Hierarchy Theorem.
Computability and Complexity 22-1 Computability and Complexity Andrei Bulatov Hierarchy Theorem.
Complexity 13-1 Complexity Andrei Bulatov Hierarchy Theorem.
P and NP Sipser (pages ). CS 311 Fall Polynomial time P = ∪ k TIME(n k ) … P = ∪ k TIME(n k ) … TIME(n 3 ) TIME(n 2 ) TIME(n)
1 Introduction to Computability Theory Lecture2: Non Deterministic Finite Automata Prof. Amos Israeli.
Finite Automata and Non Determinism
Computability and Complexity 19-1 Computability and Complexity Andrei Bulatov Non-Deterministic Space.
Complexity ©D.Moshkovitz 1 Turing Machines. Complexity ©D.Moshkovitz 2 Motivation Our main goal in this course is to analyze problems and categorize them.
1 Introduction to Computability Theory Lecture2: Non Deterministic Finite Automata (cont.) Prof. Amos Israeli.
Randomized Computation Roni Parshani Orly Margalit Eran Mantzur Avi Mintz
Complexity ©D.Moshkovits 1 Space Complexity Complexity ©D.Moshkovits 2 Motivation Complexity classes correspond to bounds on resources One such resource.
Computability and Complexity 20-1 Computability and Complexity Andrei Bulatov Class NL.
RELATIVIZATION CSE860 Vaishali Athale. Overview Introduction Idea behind “Relativization” Concept of “Oracle” Review of Diagonalization Proof Limits of.
1 Slides: Asaf Shapira & Oded Schwartz; Sonny Ben-Shimon & Yaniv Nahum. Sonny Ben-Shimon & Yaniv Nahum. Notes: Leia Passoni, Reuben Sumner, Yoad Lustig.
CS151 Complexity Theory Lecture 2 April 3, Time and Space A motivating question: –Boolean formula with n nodes –evaluate using O(log n) space?
Alternating Turing Machine (ATM) –  node is marked accept iff any of its children is marked accept. –  node is marked accept iff all of its children.
Complexity 1 Mazes And Random Walks. Complexity 2 Can You Solve This Maze?
1 Slides: Asaf Shapira & Oded Schwartz; Sonny Ben-Shimon & Yaniv Nahum. Sonny Ben-Shimon & Yaniv Nahum. Notes: Leia Passoni, Reuben Sumner, Yoad Lustig.
CS151 Complexity Theory Lecture 2 April 1, CS151 Lecture 22 Time and Space A motivating question: –Boolean formula with n nodes –evaluate using.
Non-Deterministic Space is Closed Under Complementation Neil Immerman Richard Szelepcsenyi Presented By: Subhajit Dasgupta.
Lecture 18 Various TMs. Allow the head not move Theorem. If the head is allowed to stay at the cell in each move, then every function computed by the.
CS 461 – Nov. 21 Sections 7.1 – 7.2 Measuring complexity Dividing decidable languages into complexity classes. Algorithm complexity depends on what kind.
Definition: Let M be a deterministic Turing Machine that halts on all inputs. Space Complexity of M is the function f:N  N, where f(n) is the maximum.
CSCI 4325 / 6339 Theory of Computation Zhixiang Chen.
Computational Complexity Theory Lecture 2: Reductions, NP-completeness, Cook-Levin theorem Indian Institute of Science.
Theory of Computing Lecture 21 MAS 714 Hartmut Klauck.
CS848: Topics in Databases: Foundations of Query Optimization Topics covered  Review of complexity.
Hierarchy theorems Section 9.1 Giorgi Japaridze Theory of Computability.
Computability NP complete problems. Space complexity. Homework: [Post proposal]. Find PSPACE- Complete problems. Work on presentations.
Umans Complexity Theory Lectures Lecture 1c: Robust Time & Space Classes.
Fall 2013 CMU CS Computational Complexity Lecture 2 Diagonalization, 9/12/2013.
Homework 8 Solutions Problem 1. Draw a diagram showing the various classes of languages that we have discussed and alluded to in terms of which class.
Theory of Computational Complexity Yuji Ishikawa Avis lab. M1.
Chapter 7 Introduction to Computational Complexity.
1 Turing Machines 2 Motivation Our main goal in this course is to analyze problems and categorize them according to their complexity.
CSCI 2670 Introduction to Theory of Computing November 15, 2005.
 2005 SDU Lecture14 Mapping Reducibility, Complexity.
Space Complexity Complexity ©D.Moshkovits.
Goal: Plan: Explore space complexity Low space classes: L, NL
Part VI NP-Hardness.
Turing Machines Space bounds Reductions Complexity classes
Theory of Computability
HIERARCHY THEOREMS Hu Rui Prof. Takahashi laboratory
Summary.
Theory of Computational Complexity
Theory of Computability
Factor Theorems.
Space Complexity Costas Busch - LSU.
CSC 4170 Theory of Computation Space complexity Chapter 8.
Part II Theory of Nondeterministic Computation
S P A C E In this presentation we take a closer look at complexity classes in which the bound is on the amount of memory it takes to compute the problem.
Umans Complexity Theory Lectures
Chapter 1 Regular Language
Intro to Theory of Computation
CS151 Complexity Theory Lecture 4 April 8, 2004.
Presentation transcript:

Complexity 1 The Padding Argument

Complexity 2 Motivation: Scaling-Up Complexity Claims space + non-determinism We have: space + determinism can be simulated by… We want: space + non-determinism space + determinism can be simulated by…

Complexity 3 Formally NSPACE(s 1 (n))  SPACE(s 2 (n))  NSPACE(s 1 (f(n)))  SPACE(s 2 (f(n))) Claim: For any two space constructible functions s 1 (n),s 2 (n)  logn, f(n)  n: s i (n) can be computed with space s i (n) simulation overhead E.g NSPACE(n)  SPACE(n 2 )  NSPACE(n 2 )  SPACE(n 4 )

Complexity 4 Idea NTM n space: O(s 1 (f(n))) f(n) space: s 1 (.) in the size of its input DTM space: O(s 2 (f(n))) n

Complexity 5 Padding argument Let L  NPSPACE(s 1 (f(n))) There is a 3-Tape-NTM M L : babba      Input Work |x| O(s 1 (f(|x|)))

Complexity 6 Padding argument Let L’ = { x0 f(|x|)-|x| | x  L } We’ll show a NTM M L’ which decides L’ in the same number of cells as M L. babba      Input Work f(|x|) O(s 1 (f(|x|))

Complexity 7 Padding argument – M L’ 1.Count backwards the number of 0’s and check there are f(|x|)-|x| such. 2.Run M L on x. babba      Input Work f(|x|) O(s 1 (f(|x|))) In O(log(f(|x|)) space in O(s 1 (f(|x|))) space

Complexity 8 Padding argument babba      Input Work f(|x|) O(s 1 (f(|x|))) Total space: O(s 1 (f(|x|)))

Complexity 9 Padding Argument We started with L  NSPACE(s 1 (f(n))) We showed: L’  NSPACE(s 1 (n)) Thus, L’  SPACE(s 2 (n)) Using the DTM for L’ we’ll construct a DTM for L, which will work in O(s 2 (f(n))) space.

Complexity 10 Padding Argument The DTM for L’ will simulate the DTM for L when working on its input concatenated with zeros babba   Input

Complexity 11 Padding Argument When the input head leaves the input part, just pretend it encounters 0s. keeping track after the simulated position takes O(log(f(|x|))) space. Thus our machine uses O(s 2 (f(|x|))) space.  NSPACE(s 1 (f(n)))  SPACE(s 2 (f(n)))

Complexity 12 Savitch: Generalized Version Theorem (Savitch):  S(n) ≥ log(n) NSPACE(S(n))  SPACE(S(n) 2 ) Proof: We proved NL  SPACE(log 2 n). The theorem follows from the padding argument. 

Complexity 13 Corollary Corollary: PSPACE = NPSPACE Proof: Clearly, PSPACE  NPSPACE. By Savitch’s theorem, NPSPACE  PSPACE. 