Completeness and Expressiveness

Slides:



Advertisements
Similar presentations
Some important properties Lectures of Prof. Doron Peled, Bar Ilan University.
Advertisements

PROOF BY CONTRADICTION
Lecture 3 Universal TM. Code of a DTM Consider a one-tape DTM M = (Q, Σ, Γ, δ, s). It can be encoded as follows: First, encode each state, each direction,
4.5 Inherently Ambiguous Context-free Language For some context-free languages, such as arithmetic expressions, may have many different CFG’s to generate.
Possible World Semantics for Modal Logic
1 A formula in predicate logic An atom is a formula. If F is a formula then (~F) is a formula. If F and G are Formulae then (F /\ G), (F \/ G), (F → G),
CS 461 – Nov. 9 Chomsky hierarchy of language classes –Review –Let’s find a language outside the TM world! –Hints: languages and TM are countable, but.
1 Logic Logic in general is a subfield of philosophy and its development is credited to ancient Greeks. Symbolic or mathematical logic is used in AI. In.
Inference and Reasoning. Basic Idea Given a set of statements, does a new statement logically follow from this. For example If an animal has wings and.
Copyright © Cengage Learning. All rights reserved.
1 COMP 382: Reasoning about algorithms Unit 9: Undecidability [Slides adapted from Amos Israeli’s]
Complexity 11-1 Complexity Andrei Bulatov Space Complexity.
1 Introduction to Computability Theory Lecture12: Decidable Languages Prof. Amos Israeli.
CPSC 411, Fall 2008: Set 12 1 CPSC 411 Design and Analysis of Algorithms Set 12: Undecidability Prof. Jennifer Welch Fall 2008.
Fall 2004COMP 3351 Recursively Enumerable and Recursive Languages.
Fall 2003Costas Busch - RPI1 Decidability. Fall 2003Costas Busch - RPI2 Recall: A language is decidable (recursive), if there is a Turing machine (decider)
1 Undecidability Andreas Klappenecker [based on slides by Prof. Welch]
Recursively Enumerable and Recursive Languages
1 Uncountable Sets continued Theorem: Let be an infinite countable set. The powerset of is uncountable.
Technion 1 (Yet another) decision procedure for Equality Logic Ofer Strichman and Orly Meir Technion.
1 Reducibility. 2 Problem is reduced to problem If we can solve problem then we can solve problem.
Ofer Strichman, Technion Deciding Combined Theories.
Mathematical Induction Assume that we are given an infinite supply of stamps of two different denominations, 3 cents and and 5 cents. Prove using mathematical.
Deciding a Combination of Theories - Decision Procedure - Changki pswlab Combination of Theories Daniel Kroening, Ofer Strichman Presented by Changki.
Induction and recursion
Copyright © Cengage Learning. All rights reserved. CHAPTER 4 ELEMENTARY NUMBER THEORY AND METHODS OF PROOF ELEMENTARY NUMBER THEORY AND METHODS OF PROOF.
Lecture 22 More NPC problems
Advanced Topics in Propositional Logic Chapter 17 Language, Proof and Logic.
Great Theoretical Ideas in Computer Science about AWESOME Some Generating Functions Probability Infinity MATH Some Formal Logic (which is really.
Slide 1 Propositional Definite Clause Logic: Syntax, Semantics and Bottom-up Proofs Jim Little UBC CS 322 – CSP October 20, 2014.
Propositional Logic Dr. Rogelio Dávila Pérez Profesor-Investigador División de Posgrado Universidad Autónoma Guadalajara
Course Overview and Road Map Computability and Logic.
A Universal Turing Machine
Great Theoretical Ideas in Computer Science.
1 Introduction to Abstract Mathematics Chapter 2: The Logic of Quantified Statements. Predicate Calculus Instructor: Hayk Melikya 2.3.
Great Theoretical Ideas in Computer Science.
Naïve Set Theory. Basic Definitions Naïve set theory is the non-axiomatic treatment of set theory. In the axiomatic treatment, which we will only allude.
CS6133 Software Specification and Verification
Chapter 2 Logic 2.1 Statements 2.2 The Negation of a Statement 2.3 The Disjunction and Conjunction of Statements 2.4 The Implication 2.5 More on Implications.
Automated reasoning with propositional and predicate logics Spring 2007, Juris Vīksna.
CS 103 Discrete Structures Lecture 13 Induction and Recursion (1)
1 Turing’s Thesis. 2 Turing’s thesis: Any computation carried out by mechanical means can be performed by a Turing Machine (1930)
 2005 SDU Lecture13 Reducibility — A methodology for proving un- decidability.
1 Finite Model Theory Lecture 1: Overview and Background.
1 First order theories (Chapter 1, Sections 1.4 – 1.5) From the slides for the book “Decision procedures” by D.Kroening and O.Strichman.
CS 203: Introduction to Formal Languages and Automata
CS 461 – Nov. 7 Decidability concepts –Countable = can number the elements  –Uncountable = numbering scheme impossible  –A TM undecidable –Language classes.
Mathematical Induction Section 5.1. Climbing an Infinite Ladder Suppose we have an infinite ladder: 1.We can reach the first rung of the ladder. 2.If.
Daniel Kroening and Ofer Strichman Decision Procedures An Algorithmic Point of View Deciding Combined Theories.
Lecture 21 Reducibility. Many-one reducibility For two sets A c Σ* and B c Γ*, A ≤ m B if there exists a Turing-computable function f: Σ* → Γ* such that.
Copyright © Cengage Learning. All rights reserved. CHAPTER 8 RELATIONS.
Propositional Logic Rather than jumping right into FOL, we begin with propositional logic A logic involves: §Language (with a syntax) §Semantics §Proof.
CompSci 102 Discrete Math for Computer Science March 13, 2012 Prof. Rodger Slides modified from Rosen.
Recursively Enumerable and Recursive Languages
1 Finite Model Theory Lecture 5 Turing Machines and Finite Models.
1 Undecidability Andreas Klappenecker [based on slides by Prof. Welch]
On computable numbers, with an application to the ENTSCHEIDUNGSPROBLEM COT 6421 Paresh Gupta by Alan Mathison Turing.
Metalogic Soundness and Completeness. Two Notions of Logical Consequence Validity: If the premises are true, then the conclusion must be true. Provability:
1 Section 7.1 First-Order Predicate Calculus Predicate calculus studies the internal structure of sentences where subjects are applied to predicates existentially.
Lecture 9: Query Complexity Tuesday, January 30, 2001.
1 A Universal Turing Machine. 2 Turing Machines are “hardwired” they execute only one program A limitation of Turing Machines: Real Computers are re-programmable.
Recursively Enumerable and Recursive Languages
The Propositional Calculus
CS154, Lecture 11: Self Reference, Foundation of Mathematics
Great Theoretical Ideas in Computer Science
Decidable Languages Costas Busch - LSU.
MA/CSSE 474 More Math Review Theory of Computation
Search techniques.
CS154, Lecture 11: Self Reference, Foundation of Mathematics
Properties of Relational Logic
Presentation transcript:

Completeness and Expressiveness

Consistency: a syntactic definition, related to the proof system. A set of formulas  is consistent if there is no formula  such that |-- and |--(F). Equivalent definition: |-/-F. Equivalently:  is inconsistent if for each , |--.

Lemma |-- iff  {(F)} is inconsistent. Proof: if  {(F)} is inconsistent then  {(F)} |--. Also,  {} |--.(why?) Therefore, by “proof by cases”, |--. Conversely, if |-- then from  {(F)} we can prove F (using MP), thus it is inconsistent. Consequence: |-/- iff  {(F)} consistent.

Claim (without proof) Our first order logic proof system is sound and complete. That is: |-- if and only if |== (What is the meaning of |==?)

Therefore: |-- if and only if there is some finite 0  such that 0|-- (why?) Thus: |== if and only if there is some finite 0  such that 0|== (why?)

More connections |== iff  {(F)} is unsatisfiable (why?) Thus:  {(F)} is unsatisfiable iff |== iff |-- iff  {(F)} is inconsistent. If  is consistent then either  {(F)} or  {} is consistent. Proof: if both are inconsistent, then we can prove  from either  {(F)} or  {}. Hence, we can prove using “proof by cases”,  from . Contradiction.

More connections In a similar way:  {} is unsatisfiable iff |==(F) iff |--(F) iff  {} is inconsistent. Assuming soundness and completeness:  is inconsistent iff |--F iff |==F iff  is not satisfiable. Thus: given soundness and completeness of the proof system: consistency = satisfiability!

Suppose we proved that  is consistent   is satisfiable We want to prove from this “completeness”, i.e., |==  |--. Proof:By contraposition! |-/- implies  {(F)} is consistent, implies  {(F)} is satisfiable, implies |=/=

Suppose we proved  is satisfiable   is consistent |--   {(F)} inconsistent   {(F)} unsatisfiable  |== = Soundness!!!

In short: consider the two sentences: A set of first order formulas is satisfiable iff it is consistent. The proof system we gave is sound and complete. …are two manifestations of the same thing!!!

We will not show completeness here! One principle is the construction of a maximal consistent structure, as in propositional logic (add a formula or its negation). But there is another problem: what is the interpretation of terms? Solution: initially we interpret a(b(c),d) as the string “a(b(c),d)”. What happens if we have xR(x) (actually ((R(x)F)F)? We invent new constant cx and add R(Cx) to the set of formulas. What happens when we have t1=t2? We actually need to interpret a(b(c),d) as the equivalence class of terms according to “=“ that includes a(b(c),d) (denoted [a(b(c),d)]). And we need to show that we maintain a consistent structure after adding all that …

We can learn important things from completeness. |-- iff there is a finite subset 0, 0|--. Thus, |== iff there is a finite subset 0, 0|==. |--F i.e.,  is inconsistent iff there is a finite subset of  that is inconsistent.  is consistent iff every finite subset of it is consistent! --- compactness theorem.

We can express some classes of structures (why not sets?) xR(x,x) xy(R(x,y)R(y,x)) xyz ((R(x,y)/\R(y,z))R(x,z)) We can write this using one formula! This defines the structures with R being an equivalence relation!

Provability Suppose we have a class of structures C and we want to prove something about this class. Suppose we can write a set of formulas  such that a structure S is in that class iff S satisfies all the formulas in  (with  having no free variables). Then every property  of the structures in C satisfies that |==. Proof: every structure that satisfies all the formulas in  is in C and there are supposed to satisfy . Since we have completeness, |==, thus having  allows us to prove .

A class of structures defines using an infinite set of elements Let i be a sentence that says that we have at least i elements: 2 = xy(x=y), 3 = xyz (((x=y)/\(y=z))/\(x=z))… etc. Call these collection of sentences .

Some inexpressiveness of first order logic We want to say that we have a finite number of elements in our domain. Suppose (for the contradiction) that we say exactly that using . Now, take  and any subset of . It is satisfiable (by a structure with at least as many element as the highest index in the  subset. Thus, every subset of  is also satisfiable. By compactness,  is also satisfiable – but it has an infinite model!!! Contradiction.

Having an algorithm for doing the proof? If |== then by completeness |--. We can enumerate all the possible proofs from . Say, each time to the i th step. Given enough memeory and time, if there is a proof, it would come out (recursive enumerable). On the other hand, one can write a set of formulas  describing the behavior of a model equivalent to Turing machines, and a formula  describing termination. Therefore, proving |-- is not decidable.

The big picture For some classes of structures C we can find a set of first order formulas  that are satisfied exactly by structures in C. For some other structures C, there cannot be such a set of formulas (even an infinite set). Inexpressiveness of FOL. In case we can find the set of formulas  and is a property  of C, then we can use our (complete) proof system to prove |--. This will imply that  is a property of C. But while the proof exists, we do not have a decision procedure that will check whether |-- and there is no limit on the amount of time and space needed for reaching such a proof when it exists.