Costas Busch - LSU1 Time Complexity. Costas Busch - LSU2 Consider a deterministic Turing Machine which decides a language.

Slides:



Advertisements
Similar presentations
Fall 2006Costas Busch - RPI1 Time Complexity. Fall 2006Costas Busch - RPI2 Consider a deterministic Turing Machine which decides a language.
Advertisements

Complexity Classes: P and NP
Time Complexity P vs NP.
NP-Completeness Lecture for CS 302. Traveling Salesperson Problem You have to visit n cities You want to make the shortest trip How could you do this?
The Theory of NP-Completeness
1 NP-Complete Problems. 2 We discuss some hard problems:  how hard? (computational complexity)  what makes them hard?  any solutions? Definitions 
Complexity 25-1 Complexity Andrei Bulatov #P-Completeness.
Complexity 15-1 Complexity Andrei Bulatov Hierarchy Theorem.
P and NP Sipser (pages ). CS 311 Fall Polynomial time P = ∪ k TIME(n k ) … P = ∪ k TIME(n k ) … TIME(n 3 ) TIME(n 2 ) TIME(n)
Complexity Theory CSE 331 Section 2 James Daly. Reminders Project 4 is out Due Friday Dynamic programming project Homework 6 is out Due next week (on.
Computability and Complexity 19-1 Computability and Complexity Andrei Bulatov Non-Deterministic Space.
NP-Complete Problems Reading Material: Chapter 10 Sections 1, 2, 3, and 4 only.
1 Polynomial Time Reductions Polynomial Computable function : For any computes in polynomial time.
The Theory of NP-Completeness
NP-Complete Problems Problems in Computer Science are classified into
1 Other Models of Computation. 2 Models of computation: Turing Machines Recursive Functions Post Systems Rewriting Systems.
Fall 2003Costas Busch - RPI1 Decidable Problems of Regular Languages.
Analysis of Algorithms CS 477/677
Chapter 11: Limitations of Algorithmic Power
Fall 2004COMP 3351 Time Complexity We use a multitape Turing machine We count the number of steps until a string is accepted We use the O(k) notation.
Chapter 11 Limitations of Algorithm Power Copyright © 2007 Pearson Addison-Wesley. All rights reserved.
Prof. Busch - LSU1 Undecidable Problems (unsolvable problems)
Prof. Busch - RPI1 Decidable Problems of Regular Languages.
The Theory of NP-Completeness 1. Nondeterministic algorithms A nondeterminstic algorithm consists of phase 1: guessing phase 2: checking If the checking.
1 The Theory of NP-Completeness 2012/11/6 P: the class of problems which can be solved by a deterministic polynomial algorithm. NP : the class of decision.
Introduction to the Theory of Computation
CSE 024: Design & Analysis of Algorithms Chapter 9: NP Completeness Sedgewick Chp:40 David Luebke’s Course Notes / University of Virginia, Computer Science.
1 Lower Bounds Lower bound: an estimate on a minimum amount of work needed to solve a given problem Examples: b number of comparisons needed to find the.
CSCI 3160 Design and Analysis of Algorithms Tutorial 10 Chengyu Lin.
NP-Complete Problems. Running Time v.s. Input Size Concern with problems whose complexity may be described by exponential functions. Tractable problems.
P Vs NP Turing Machine. Definitions - Turing Machine Turing Machine M has a tape of squares Each Square is capable of storing a symbol from set Γ (including.
Lecture 12 P and NP Introduction to intractability Class P and NP Class NPC (NP-complete)
NP-completeness Class of hard problems. Jaruloj ChongstitvatanaNP-complete Problems2 Outline  Introduction  Problems and Languages Turing machines and.
CS 3813: Introduction to Formal Languages and Automata Chapter 14 An Introduction to Computational Complexity These class notes are based on material from.
Chapter 11 Introduction to Computational Complexity Copyright © 2011 The McGraw-Hill Companies, Inc. Permission required for reproduction or display. 1.
NPC.
1 Time Complexity We use a multitape Turing machine We count the number of steps until a string is accepted We use the O(k) notation.
Young CS 331 D&A of Algo. NP-Completeness1 NP-Completeness Reference: Computers and Intractability: A Guide to the Theory of NP-Completeness by Garey and.
NP-complete Languages
CSCI 2670 Introduction to Theory of Computing December 2, 2004.
NP ⊆ PCP(n 3, 1) Theory of Computation. NP ⊆ PCP(n 3,1) What is that? NP ⊆ PCP(n 3,1) What is that?
Prof. Busch - LSU1 Time Complexity. Prof. Busch - LSU2 Consider a deterministic Turing Machine which decides a language.
Computability Examples. Reducibility. NP completeness. Homework: Find other examples of NP complete problems.
The NP class. NP-completeness Lecture2. The NP-class The NP class is a class that contains all the problems that can be decided by a Non-Deterministic.
Costas Busch - RPI1 Decidability. Costas Busch - RPI2 Consider problems with answer YES or NO Examples: Does Machine have three states ? Is string a binary.
The Theory of NP-Completeness
NP-Completeness A problem is NP-complete if: It is in NP
The NP class. NP-completeness
Chapter 10 NP-Complete Problems.
Turing’s Thesis Costas Busch - LSU.
Advanced Algorithms Analysis and Design
Introduction to the Theory of Computation
Time Complexity Costas Busch - LSU.
Reductions Costas Busch - LSU.
Other Models of Computation
Busch Complexity Lectures: Undecidable Problems (unsolvable problems)
Undecidable Problems (unsolvable problems)
How Hard Can It Be?.
Computational Complexity
Decidable Languages Costas Busch - LSU.
Space Complexity Costas Busch - LSU.
Time Complexity We use a multitape Turing machine
Decidable Problems of Regular Languages
Turing acceptable languages and Enumerators
CS154, Lecture 13: P vs NP.
NP-Completeness Reference: Computers and Intractability: A Guide to the Theory of NP-Completeness by Garey and Johnson, W.H. Freeman and Company, 1979.
CSE 589 Applied Algorithms Spring 1999
Instructor: Aaron Roth
The Chomsky Hierarchy Costas Busch - LSU.
Presentation transcript:

Costas Busch - LSU1 Time Complexity

Costas Busch - LSU2 Consider a deterministic Turing Machine which decides a language

Costas Busch - LSU3 For any string the computation of terminates in a finite amount of transitions Accept or Reject Initial state

Costas Busch - LSU4 Accept or Reject Decision Time = #transitions Initial state

Costas Busch - LSU5 Consider now all strings of length = maximum time required to decide any string of length

Costas Busch - LSU6 Max time to accept a string of length STRING LENGTH TIME

Costas Busch - LSU7 Time Complexity Class: All Languages decidable by a deterministic Turing Machine in time

Costas Busch - LSU8 Example: This can be decided in time

Costas Busch - LSU9 Other example problems in the same class

Costas Busch - LSU10 Examples in class:

Costas Busch - LSU11 Examples in class: CYK algorithm Matrix multiplication

Costas Busch - LSU12 Polynomial time algorithms: Represents tractable algorithms: for small we can decide the result fast constant

Costas Busch - LSU13 It can be shown:

Costas Busch - LSU14 The Time Complexity Class “tractable” problems polynomial time algorithms Represents:

Costas Busch - LSU15 CYK-algorithm Class Matrix multiplication

Costas Busch - LSU16 Exponential time algorithms: Represent intractable algorithms: Some problem instances may take centuries to solve

Costas Busch - LSU17 Example: the Hamiltonian Path Problem Question: is there a Hamiltonian path from s to t? s t

Costas Busch - LSU18 s t YES!

Costas Busch - LSU19 Exponential time Intractable problem A solution: search exhaustively all paths L = { : there is a Hamiltonian path in G from s to t}

Costas Busch - LSU20 The clique problem Does there exist a clique of size 5?

Costas Busch - LSU21 The clique problem Does there exist a clique of size 5?

Costas Busch - LSU22 Example: The Satisfiability Problem Boolean expressions in Conjunctive Normal Form: Variables Question: is the expression satisfiable? clauses

Costas Busch - LSU23 Satisfiable: Example:

Costas Busch - LSU24 Not satisfiable Example:

Costas Busch - LSU25 Algorithm: search exhaustively all the possible binary values of the variables exponential

Costas Busch - LSU26 Non-Determinism Language class: A Non-Deterministic Turing Machine decides each string of length in time

Costas Busch - LSU27 … … … … accept reject (deepest leaf) depth All computations of on string

Costas Busch - LSU28 Non-Deterministic Polynomial time algorithms:

Costas Busch - LSU29 The class Non-Deterministic Polynomial time

Costas Busch - LSU30 Example: The satisfiability problem Non-Deterministic algorithm: Guess an assignment of the variables Check if this is a satisfying assignment

Costas Busch - LSU31 Time for variables: Total time: Guess an assignment of the variables Check if this is a satisfying assignment

Costas Busch - LSU32 The satisfiability problem is a - Problem

Costas Busch - LSU33 Observation: Deterministic Polynomial Non-Deterministic Polynomial

Costas Busch - LSU34 Open Problem: WE DO NOT KNOW THE ANSWER

Costas Busch - LSU35 Example: Does the Satisfiability problem have a polynomial time deterministic algorithm? WE DO NOT KNOW THE ANSWER Open Problem: