S.1 May 21, 2005 Copyright A.R. Meyer 2005, all rights reserved A Supervisor’s Reminiscence What We Were Thinking Albert R. Meyer.

Slides:



Advertisements
Similar presentations
Lecture 9. Resource bounded KC K-, and C- complexities depend on unlimited computational resources. Kolmogorov himself first observed that we can put resource.
Advertisements

CS 345: Chapter 9 Algorithmic Universality and Its Robustness
Lecture 24 MAS 714 Hartmut Klauck
1 Nondeterministic Space is Closed Under Complement Presented by Jing Zhang and Yingbo Wang Theory of Computation II Professor: Geoffrey Smith.
CS 461 – Nov. 9 Chomsky hierarchy of language classes –Review –Let’s find a language outside the TM world! –Hints: languages and TM are countable, but.
Complexity Theory Lecture 1 Lecturer: Moni Naor. Computational Complexity Theory Study the resources needed to solve computational problems –Computer.
Finite Automata Section 1.1 CSC 4170 Theory of Computation.
Complexity 7-1 Complexity Andrei Bulatov Complexity of Problems.
Computability and Complexity 5-1 Classifying Problems Computability and Complexity Andrei Bulatov.
1 Undecidability Andreas Klappenecker [based on slides by Prof. Welch]
Complexity 11-1 Complexity Andrei Bulatov Space Complexity.
Computability and Complexity 22-1 Computability and Complexity Andrei Bulatov Hierarchy Theorem.
Computability and Complexity 13-1 Computability and Complexity Andrei Bulatov The Class NP.
CS151 Complexity Theory Lecture 3 April 6, Nondeterminism: introduction A motivating question: Can computers replace mathematicians? L = { (x,
CPSC 411, Fall 2008: Set 12 1 CPSC 411 Design and Analysis of Algorithms Set 12: Undecidability Prof. Jennifer Welch Fall 2008.
Reducibility A reduction is a way of converting one problem into another problem in such a way that a solution to the second problem can be used to solve.
Finite Automata Finite-state machine with no output. FA consists of States, Transitions between states FA is a 5-tuple Example! A string x is recognized.
Complexity 5-1 Complexity Andrei Bulatov Complexity of Problems.
Transparency No. 4-1 Formal Language and Automata Theory Chapter 4 Patterns, Regular Expressions and Finite Automata (include lecture 7,8,9) Transparency.
FORMAL LANGUAGES, AUTOMATA AND COMPUTABILITY Read sections 7.1 – 7.3 of the book for next time.
FORMAL LANGUAGES, AUTOMATA AND COMPUTABILITY
CHAPTER 4 Decidability Contents Decidable Languages
79 Regular Expression Regular expressions over an alphabet  are defined recursively as follows. (1) Ø, which denotes the empty set, is a regular expression.
Theory of Computing Lecture 20 MAS 714 Hartmut Klauck.
Nondeterminism (Deterministic) FA required for every state q and every symbol  of the alphabet to have exactly one arrow out of q labeled . What happens.
Regular Languages A language is regular over  if it can be built from ;, {  }, and { a } for every a 2 , using operators union ( [ ), concatenation.
CMPS 3223 Theory of Computation Automata, Computability, & Complexity by Elaine Rich ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Slides provided.
NFA ε - NFA - DFA equivalence. What is an NFA An NFA is an automaton that its states might have none, one or more outgoing arrows under a specific symbol.
Theory of Computing Lecture 15 MAS 714 Hartmut Klauck.
Model Checking Lecture 3 Tom Henzinger. Model-Checking Problem I |= S System modelSystem property.
DECIDABILITY OF PRESBURGER ARITHMETIC USING FINITE AUTOMATA Presented by : Shubha Jain Reference : Paper by Alexandre Boudet and Hubert Comon.
Review Byron Gao. Overview Theory of computation: central areas: Automata, Computability, Complexity Computability: Is the problem solvable? –solvable.
Theory of Computation, Feodor F. Dragan, Kent State University 1 Regular expressions: definition An algebraic equivalent to finite automata. We can build.
February 18, 2015CS21 Lecture 181 CS21 Decidability and Tractability Lecture 18 February 18, 2015.
Analysis of Algorithms
Computational Complexity Theory Lecture 2: Reductions, NP-completeness, Cook-Levin theorem Indian Institute of Science.
Theory of Computing Lecture 17 MAS 714 Hartmut Klauck.
Introduction to CS Theory Lecture 3 – Regular Languages Piotr Faliszewski
Decidable Questions About Regular languages 1)Membership problem: “Given a specification of known type and a string w, is w in the language specified?”
Week 10Complexity of Algorithms1 Hard Computational Problems Some computational problems are hard Despite a numerous attempts we do not know any efficient.
Theory of Computing Lecture 21 MAS 714 Hartmut Klauck.
1 Design and Analysis of Algorithms Yoram Moses Lecture 11 June 3, 2010
Games, Logic and Automata Seminar Rotem Zach 1. Overview 2.
Strings Basic data type in computational biology A string is an ordered succession of characters or symbols from a finite set called an alphabet Sequence.
Transparency No. 4-1 Formal Language and Automata Theory Chapter 4 Patterns, Regular Expressions and Finite Automata (include lecture 7,8,9) Transparency.
Minimal NFA Problems are hard Tao Jiang & B. Ravikumar N Andres Parra.
Fall 2013 CMU CS Computational Complexity Lecture 2 Diagonalization, 9/12/2013.
Introduction Why do we study Theory of Computation ?
1 Undecidability Andreas Klappenecker [based on slides by Prof. Welch]
CSCI 4325 / 6339 Theory of Computation Zhixiang Chen.
The Church-Turing Thesis Chapter Are We Done? FSM  PDA  Turing machine Is this the end of the line? There are still problems we cannot solve:
Theory of Computational Complexity TA : Junichi Teruyama Iwama lab. D3
1. What is Totality problem? 2. What is ji(x)?
MA/CSSE 474 Theory of Computation Decision Problems, Continued DFSMs.
 2005 SDU Lecture14 Mapping Reducibility, Complexity.
The Acceptance Problem for TMs
Why do we study Theory of Computation ?
CSE 105 theory of computation
CSCI 2670 Introduction to Theory of Computing
Turing Machines Acceptors; Enumerators
Summary.
CSCE 411 Design and Analysis of Algorithms
Why do we study Theory of Computation ?
Computability & Complexity I
Part II Theory of Nondeterministic Computation
Recall last lecture and Nondeterministic TMs
CSE 105 theory of computation
Instructor: Aaron Roth
CHAPTER 1 Regular Languages
Presentation transcript:

S.1 May 21, 2005 Copyright A.R. Meyer 2005, all rights reserved A Supervisor’s Reminiscence What We Were Thinking Albert R. Meyer

S.2 May 21, 2005 Copyright A.R. Meyer 2005, all rights reserved My concerns '67-'72: (1) Was speedup ``real'' -- any sets with speedup not explicitly constructed (by diagonalization) to have it? (2) Was there any ``real'' problem that was definitely not in P? (3) How to defend a complexity theory which treated all finite problems as trivial?

S.3 May 21, 2005 Copyright A.R. Meyer 2005, all rights reserved Larrys' thesis provided definitive answers to all these questions.

S.4 May 21, 2005 Copyright A.R. Meyer 2005, all rights reserved A neat, but overlooked, result from Larry's thesis.

S.5 May 21, 2005 Copyright A.R. Meyer 2005, all rights reserved Language L has IO-speedup if, when M accepts L, then 9 M' accepting L, and M' is very fast at 1‘ly many inputs where M is slow, (same time on other inputs)

S.6 May 21, 2005 Copyright A.R. Meyer 2005, all rights reserved Pretty much all the problems known to be complete for the usual time and space bounded complexity classes have corresponding IO-speedup.

S.7 May 21, 2005 Copyright A.R. Meyer 2005, all rights reserved Cor: Let SF := {star-free reg. exps R | L(R) = ;} SF has 2 2 2…n -IO-speedup

S.8 May 21, 2005 Copyright A.R. Meyer 2005, all rights reserved Definition: Let M be a program, x an input word, f(n) a time fcn. Say “M(x) is slow” if on input x, M takes > f(|x|) steps.

S.9 May 21, 2005 Copyright A.R. Meyer 2005, all rights reserved Definition: Let M be a program, x an input word, f(n) a time fcn. Say “M(x) is very fast” if on input x, M takes O(|x|) steps (that is, linear time)

S.10 May 21, 2005 Copyright A.R. Meyer 2005, all rights reserved Definition: Let D µ  * be decidable. D has f-IO-speedup if, whenever L(M) = D, there is M' with L(M) = D, and for infinitely many x, M‘(x) is very fast while M(x) is slow (M’ takes same time as M at other x.)

S.11 May 21, 2005 Copyright A.R. Meyer 2005, all rights reserved Thm [Blum, McCreight-Meyer] Let D f := {M | M rejects input “M” or takes > f(|M|) steps} Then D f has f-IO-speedup.

S.12 May 21, 2005 Copyright A.R. Meyer 2005, all rights reserved That is, M 2 D f iff M rejects "M " or is slow on it.

S.13 May 21, 2005 Copyright A.R. Meyer 2005, all rights reserved Pf: Suppose D f = L(M 0 ). So M 0 accepts "M " iff M rejects "M " or is slow on it. So, letting M be M 0, M 0 accepts “M 0,” but slowly.

S.14 May 21, 2005 Copyright A.R. Meyer 2005, all rights reserved Cool Trick: let M 0,n be same as M 0 but padded with n useless instructions. So M 0,n behaves exactly like M 0, just bigger.

S.15 May 21, 2005 Copyright A.R. Meyer 2005, all rights reserved So M 0,n accepts "M 0,n ” slowly, so M 0 accepts "M 0,n ” slowly. Define M 0 ' to accept "M 0,n ” very fast for all n, otherwise, same as M 0. M 0 ’ speeds up M 0. QED

S.16 May 21, 2005 Copyright A.R. Meyer 2005, all rights reserved Lemma [Meyer/Stockmeyer] IO-speedup inherits up “efficient invertible“ reducibility.

S.17 May 21, 2005 Copyright A.R. Meyer 2005, all rights reserved r is "good" if it is 1-1, linear-bounded, "easy to compute," and the same for r -1. If A has f-IO-speedup, and x 2 A iff r(x) 2 B, then B has (  f )-IOspeedup

S.18 May 21, 2005 Copyright A.R. Meyer 2005, all rights reserved The story behind the SF result My Background from Harvard ’62-‘67: Recursion theory from Rogers & P. Fischer · m, arithmetic hierarchy Complexity thy: Rabin, Hartmanis-Stearns, Blum Speedup, compression, IO and AE Finite Automata: S. Even, Ginsburg Krohn-Rhodes on star-free events Automata & Logic: Wang, Buchi WS1S just another notation for FA’s

S.19 May 21, 2005 Copyright A.R. Meyer 2005, all rights reserved Efficient reducibility: McCreight's thesis, CMU '68 Circuit complexity: Winograd, Ehrenfeucht Cook & Karp '72 Polytime ·: NP as 9 polysize x

S.20 May 21, 2005 Copyright A.R. Meyer 2005, all rights reserved With this background, not surprising that I should propose a polytime analog of the arithmetic hierarchy. But I wanted to show it was useful for classifying problems. Suggested to Larry that he fit reg.exp. equivalence into the hierarchy.

S.21 May 21, 2005 Copyright A.R. Meyer 2005, all rights reserved Larry came back (next day?) and said reg.exp. equiv NOT IN the hierarchy! He showed me how to reduce every poly-class to reg.exp. equiv. I pointed out that all he was using about poly-classes was they were in polyspace. He had shown reg.exp. equiv. was poly-space hard!

S.22 May 21, 2005 Copyright A.R. Meyer 2005, all rights reserved Driving home I started thinking ``why polynomial?'‘ Realized the crux was a linear size expression for set of all length n strings.

S.23 May 21, 2005 Copyright A.R. Meyer 2005, all rights reserved I knew how to get a nondeterministic FA to recognize all strings differing from the sequence of all consecutive n-bit strings. So with complement and a “smoothing” operation to turn one long string into all long strings, I could get a linear size expression for length 2 n strings, and could iterate the construction to get super-exponential lower bounds on reg-exps with complement & smoothing.

S.24 May 21, 2005 Copyright A.R. Meyer 2005, all rights reserved And the equiv. prob for these expressions was easy to reduce to the decidable logical theory WS1S, so it too had super-exponential lower bound. WOW!

S.25 May 21, 2005 Copyright A.R. Meyer 2005, all rights reserved I called Mike Fischer (around midnight) to tell him what I'd figured out (and to make sure I wasn't kidding myself). Next day(?) I explained it to Larry and suggested he work on getting rid of the ad hoc ``smoothing'' operation. Later he got rid of ``star'' too. We were off and running.