Fall 2006Costas Busch - RPI1 Undecidable Problems (unsolvable problems)

Slides:



Advertisements
Similar presentations
Linear Bounded Automata LBAs
Advertisements

CS 461 – Nov. 9 Chomsky hierarchy of language classes –Review –Let’s find a language outside the TM world! –Hints: languages and TM are countable, but.
Fall 2006Costas Busch - RPI1 Non-regular languages (Pumping Lemma)
1 Section 14.1 Computability Some problems cannot be solved by any machine/algorithm. To prove such statements we need to effectively describe all possible.
Fall 2004COMP 3351 Undecidable problems for Recursively enumerable languages continued…
Prof. Busch - LSU1 Decidable Languages. Prof. Busch - LSU2 Recall that: A language is Turing-Acceptable if there is a Turing machine that accepts Also.
Courtesy Costas Busch - RPI1 A Universal Turing Machine.
Courtesy Costas Busch - RPI1 Non Deterministic Automata.
Fall 2004COMP 3351 Recursively Enumerable and Recursive Languages.
Costas Busch - RPI1 Undecidable problems for Recursively enumerable languages continued…
Fall 2003Costas Busch - RPI1 Decidability. Fall 2003Costas Busch - RPI2 Recall: A language is decidable (recursive), if there is a Turing machine (decider)
Recursively Enumerable and Recursive Languages
Costas Busch - RPI1 Standard Representations of Regular Languages Regular Languages DFAs NFAs Regular Expressions Regular Grammars.
1 The Chomsky Hierarchy. 2 Unrestricted Grammars: Rules have form String of variables and terminals String of variables and terminals.
1 Uncountable Sets continued Theorem: Let be an infinite countable set. The powerset of is uncountable.
Fall 2006Costas Busch - RPI1 The Post Correspondence Problem.
Fall 2004COMP 3351 The Chomsky Hierarchy. Fall 2004COMP 3352 Non-recursively enumerable Recursively-enumerable Recursive Context-sensitive Context-free.
CHAPTER 4 Decidability Contents Decidable Languages
Fall 2003Costas Busch - RPI1 Decidable Problems of Regular Languages.
Fall 2004COMP 3351 Reducibility. Fall 2004COMP 3352 Problem is reduced to problem If we can solve problem then we can solve problem.
Linear Bounded Automata LBAs
1 Decidability continued. 2 Undecidable Problems Halting Problem: Does machine halt on input ? State-entry Problem: Does machine enter state halt on input.
Automata & Formal Languages, Feodor F. Dragan, Kent State University 1 CHAPTER 5 Reducibility Contents Undecidable Problems from Language Theory.
Fall 2006Costas Busch - RPI1 Non-Deterministic Finite Automata.
Fall 2005Costas Busch - RPI1 Recursively Enumerable and Recursive Languages.
Courtesy Costas Busch - RPI1 Reducibility. Courtesy Costas Busch - RPI2 Problem is reduced to problem If we can solve problem then we can solve problem.
Prof. Busch - LSU1 Undecidable Problems (unsolvable problems)
Prof. Busch - LSU1 Reductions. Prof. Busch - LSU2 Problem is reduced to problem If we can solve problem then we can solve problem.
1 Reducibility. 2 Problem is reduced to problem If we can solve problem then we can solve problem.
CS5371 Theory of Computation Lecture 12: Computability III (Decidable Languages relating to DFA, NFA, and CFG)
The Halting Problem – Undecidable Languages Lecture 31 Section 4.2 Wed, Oct 31, 2007.
1 1 CDT314 FABER Formal Languages, Automata and Models of Computation Lecture 15-1 Mälardalen University 2012.
A Universal Turing Machine
1 Turing’s Thesis. 2 Turing’s thesis: Any computation carried out by mechanical means can be performed by a Turing Machine (1930)
 2005 SDU Lecture13 Reducibility — A methodology for proving un- decidability.
1Computer Sciences Department. Book: INTRODUCTION TO THE THEORY OF COMPUTATION, SECOND EDITION, by: MICHAEL SIPSER Reference 3Computer Sciences Department.
D E C I D A B I L I T Y 1. 2 Objectives To investigate the power of algorithms to solve problems. To explore the limits of algorithmic solvability. To.
Recursively Enumerable and Recursive Languages
1 Linear Bounded Automata LBAs. 2 Linear Bounded Automata (LBAs) are the same as Turing Machines with one difference: The input string tape space is the.
1 The Chomsky Hierarchy. 2 Unrestricted Grammars: Productions String of variables and terminals String of variables and terminals.
Costas Busch - RPI1 Decidability. Costas Busch - RPI2 Consider problems with answer YES or NO Examples: Does Machine have three states ? Is string a binary.
Costas Busch - RPI1 Decidability. Costas Busch - RPI2 Another famous undecidable problem: The halting problem.
1 Recursively Enumerable and Recursive Languages.
CSC 3130: Automata theory and formal languages Andrej Bogdanov The Chinese University of Hong Kong Undecidable.
Recursively Enumerable and Recursive Languages. Definition: A language is recursively enumerable if some Turing machine accepts it.
Decidability.
Fall 2006Costas Busch - RPI1 RE languages and Enumerators.
Chapters 11 and 12 Decision Problems and Undecidability.
The Acceptance Problem for TMs
Recursively Enumerable and Recursive Languages
Busch Complexity Lectures: Reductions
Linear Bounded Automata LBAs
Reductions.
Undecidable Problems Costas Busch - LSU.
Reductions Costas Busch - LSU.
Busch Complexity Lectures: Undecidable Problems (unsolvable problems)
Undecidable Problems (unsolvable problems)
Turing acceptable languages and Enumerators
CS154, Lecture 8: Undecidability, Mapping Reductions
CS154, Lecture 8: Undecidability, Mapping Reductions
Decidable Languages Costas Busch - LSU.
Decidability and Undecidability
The Post Correspondence Problem
Elementary Questions about Regular Languages
Non-regular languages
Decidable Problems of Regular Languages
Turing acceptable languages and Enumerators
Undecidable problems:
Formal Languages, Automata and Models of Computation
Decidability continued….
Presentation transcript:

Fall 2006Costas Busch - RPI1 Undecidable Problems (unsolvable problems)

Fall 2006Costas Busch - RPI2 Recall that: A language is decidable, if there is a Turing machine (decider) that accepts the language and halts on every input string Turing Machine Input string Accept Reject Decider for Decision On Halt: Decidable Languages YES NO

Fall 2006Costas Busch - RPI3 A computational problem is decidable if the corresponding language is decidable We also say that the problem is solvable

Fall 2006Costas Busch - RPI4 Problem: Does DFA accept the empty language ? Corresponding Language: Description of DFA as a string (For example, we can represent as a binary string, as we did for Turing machines) (Decidable)

Fall 2006Costas Busch - RPI5 Determine whether there is a path from the initial state to any accepting state Decider for : On input : DFA Reject Decision: Accept

Fall 2006Costas Busch - RPI6 Problem: Does DFA accept a finite language? Corresponding Language:(Decidable)

Fall 2006Costas Busch - RPI7 Decider for : On input : DFA Reject Decision: Accept Check if there is a walk with a cycle from the initial state to an accepting state infinitefinite (NO) (YES)

Fall 2006Costas Busch - RPI8 Problem: Does DFA accept string ? Corresponding Language:(Decidable)

Fall 2006Costas Busch - RPI9 Decider for : On input string : Run DFA on input string If accepts Then accept (and halt) Else reject (and halt)

Fall 2006Costas Busch - RPI10 Problem: Do DFAs and accept the same language? Corresponding Language:(Decidable)

Fall 2006Costas Busch - RPI11 Let be the language of DFA Decider for : On input : Construct DFA such that: (combination of DFAs)

Fall 2006Costas Busch - RPI12 and

Fall 2006Costas Busch - RPI13 or

Fall 2006Costas Busch - RPI14 Therefore, we only need to determine whether which is a solvable problem for DFAs:

Fall 2006Costas Busch - RPI15 Undecidable Languages there is no Turing Machine which accepts the language and makes a decision (halts) for every input string undecidable language = not decidable language There is no decider: (machine may make decision for some input strings)

Fall 2006Costas Busch - RPI16 For an undecidable language, the corresponding problem is undecidable (unsolvable): there is no Turing Machine (Algorithm) that gives an answer (yes or no) for every input instance (answer may be given for some input instances)

Fall 2006Costas Busch - RPI17 We have shown before that there are undecidable languages: Decidable Turing-Acceptable is Turing-Acceptable and undecidable

Fall 2006Costas Busch - RPI18 We will prove that two particular problems are unsolvable: Membership problem Halting problem

Fall 2006Costas Busch - RPI19 Membership Problem Input:Turing Machine String Question: Does accept ? Corresponding language:

Fall 2006Costas Busch - RPI20 Theorem: (The membership problem is unsolvable) Proof: We will assume that is decidable; We will then prove that every decidable language is Turing-Acceptable is undecidable Basic idea: A contradiction!

Fall 2006Costas Busch - RPI21 Suppose that is decidable YES accepts NO rejects Decider for Input string

Fall 2006Costas Busch - RPI22 Let be a Turing recognizable language Let be the Turing Machine that accepts We will prove that is also decidable: we will build a decider for

Fall 2006Costas Busch - RPI23 NO YES accept reject Decider for (and halt) Decider for Input string accepts ? String description of

Fall 2006Costas Busch - RPI24 Therefore,is decidable But there is a Turing-Acceptable language which is undecidable Contradiction!!!! Since is chosen arbitrarily, every Turing-Acceptable language is decidable END OF PROOF

Fall 2006Costas Busch - RPI25 We have shown: Decidable Undecidable

Fall 2006Costas Busch - RPI26 We can actually show: Decidable Turing-Acceptable

Fall 2006Costas Busch - RPI27 Turing machine that accepts : 1. Run on input 2. If accepts then accept is Turing-Acceptable

Fall 2006Costas Busch - RPI28 Halting Problem Input:Turing Machine String Question: Does halt while processing input string ? Corresponding language:

Fall 2006Costas Busch - RPI29 Theorem: (The halting problem is unsolvable) Proof: Suppose that is decidable; we will prove that every decidable language is also Turing-Acceptable is undecidable Basic idea: A contradiction!

Fall 2006Costas Busch - RPI30 YES halts on input doesn’t halt on input NO Suppose that is decidable Decider for Input string

Fall 2006Costas Busch - RPI31 Let be a Turing-Acceptable language Let be the Turing Machine that accepts We will prove that is also decidable: we will build a decider for

Fall 2006Costas Busch - RPI32 halts and accepts halts on ? YES NO Run with input reject accept reject Decider for Input string Decider for and halt halts and rejects and halt

Fall 2006Costas Busch - RPI33 Contradiction!!!! END OF PROOF Therefore,is decidable But there is a Turing-Acceptable language which is undecidable Since is chosen arbitrarily, every Turing-Acceptable language is decidable

Fall 2006Costas Busch - RPI34 Theorem: Proof: Assume for contradiction that the halting problem is decidable; (The halting problem is unsolvable) is undecidable we will obtain a contradiction using a diagonilization technique An alternative proof Basic idea:

Fall 2006Costas Busch - RPI35 YEShalts on doesn’t halt on NO Suppose that is decidable Decider for Input string

Fall 2006Costas Busch - RPI36 Input string: YES NO Looking inside Decider for halts on ?

Fall 2006Costas Busch - RPI37 NO Loop forever YES Construct machine : If halts on input Then Loop Forever Else Halt halts on ?

Fall 2006Costas Busch - RPI38 Construct machine : Copy on tape If halts on input Then loop forever Else halt

Fall 2006Costas Busch - RPI39 Run with input itself Copy on tape If halts on input Then loops forever on input Else halts on input END OF PROOF CONTRADICTION!!!

Fall 2006Costas Busch - RPI40 We have shown: Decidable Undecidable

Fall 2006Costas Busch - RPI41 We can actually show: Decidable Turing-Acceptable

Fall 2006Costas Busch - RPI42 Turing machine that accepts : 1. Run on input 2. If halts on then accept is Turing-Acceptable