The Power of Correction Queries Cristina Bibire Research Group on Mathematical Linguistics, Rovira i Virgili University Pl. Imperial Tarraco 1, 43005,

Slides:



Advertisements
Similar presentations
Properties of Regular Sets
Advertisements

Lecture 3 Universal TM. Code of a DTM Consider a one-tape DTM M = (Q, Σ, Γ, δ, s). It can be encoded as follows: First, encode each state, each direction,
Chapter Three: Closure Properties for Regular Languages
CSE 311 Foundations of Computing I
Lecture 24 MAS 714 Hartmut Klauck
Lecture 9,10 Theory of AUTOMATA
Fall 2006Costas Busch - RPI1 Non-regular languages (Pumping Lemma)
3.2 Pumping Lemma for Regular Languages Given a language L, how do we know whether it is regular or not? If we can construct an FA to accept the language.
CSCI 2670 Introduction to Theory of Computing September 13, 2005.
1 Undecidability Andreas Klappenecker [based on slides by Prof. Welch]
Finite Automata Great Theoretical Ideas In Computer Science Anupam Gupta Danny Sleator CS Fall 2010 Lecture 20Oct 28, 2010Carnegie Mellon University.
Introduction to Computability Theory
1 Introduction to Computability Theory Lecture4: Non Regular Languages Prof. Amos Israeli.
Courtesy Costas Busch - RPI1 More Applications of the Pumping Lemma.
CPSC 411, Fall 2008: Set 12 1 CPSC 411 Design and Analysis of Algorithms Set 12: Undecidability Prof. Jennifer Welch Fall 2008.
1 Undecidability Andreas Klappenecker [based on slides by Prof. Welch]
1 More Properties of Regular Languages. 2 We have proven Regular languages are closed under: Union Concatenation Star operation Reverse.
1 Regular Expressions. 2 Regular expressions describe regular languages Example: describes the language.
Costas Busch - RPI1 Standard Representations of Regular Languages Regular Languages DFAs NFAs Regular Expressions Regular Grammars.
1 Introduction to Computability Theory Lecture4: Non Regular Languages Prof. Amos Israeli.
CHAPTER 4 Decidability Contents Decidable Languages
1 Single Final State for NFAs and DFAs. 2 Observation Any Finite Automaton (NFA or DFA) can be converted to an equivalent NFA with a single final state.
1 More Applications of the Pumping Lemma. 2 The Pumping Lemma: Given a infinite regular language there exists an integer for any string with length we.
Courtesy Costas Busch - RPI1 Non-regular languages.
Fall 2004COMP 3351 Standard Representations of Regular Languages Regular Languages DFAs NFAs Regular Expressions Regular Grammars.
CS5371 Theory of Computation Lecture 4: Automata Theory II (DFA = NFA, Regular Language)
Lecture 8 Sept 29, 2011 Regular expressions – examples Converting DFA to regular expression. (same works for NFA to r.e. conversion.) Converting R.E. to.
Theory of Computing Lecture 22 MAS 714 Hartmut Klauck.
Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)
Prof. Busch - LSU1 More Applications of the Pumping Lemma.
1 Non-regular languages. 2 Regular languages Non-regular languages.
1 Introduction to Computability Theory Lecture11: The Halting Problem Prof. Amos Israeli.
1 A Single Final State for Finite Accepters. 2 Observation Any Finite Accepter (NFA or DFA) can be converted to an equivalent NFA with a single final.
Chapter 8. Section 8. 1 Section Summary Introduction Modeling with Recurrence Relations Fibonacci Numbers The Tower of Hanoi Counting Problems Algorithms.
Learning DFA from corrections Leonor Becerra-Bonache, Cristina Bibire, Adrian Horia Dediu Research Group on Mathematical Linguistics, Rovira i Virgili.
Learning Automata and Grammars Peter Černo.  The problem of learning or inferring automata and grammars has been studied for decades and has connections.
Introduction to CS Theory
Decidable Questions About Regular languages 1)Membership problem: “Given a specification of known type and a string w, is w in the language specified?”
Prof. Busch - LSU1 NFAs accept the Regular Languages.
Chapter 4 Pumping Lemma Properties of Regular Languages Decidable questions on Regular Languages.
Inferring Finite Automata from queries and counter-examples Eggert Jón Magnússon.
CS 3240 – Chapter 4.  Closure Properties  Algorithms for Elementary Questions:  Is a given word, w, in L?  Is L empty, finite or infinite?  Are L.
1 A well-parenthesized string is a string with the same number of (‘s as )’s which has the property that every prefix of the string has at least as many.
CSCI 2670 Introduction to Theory of Computing September 13.
CS 203: Introduction to Formal Languages and Automata
Classifications LanguageGrammarAutomaton Regular, right- linear Right-linear, left-linear DFA, NFA Context-free PDA Context- sensitive LBA Recursively.
Learning regular tree languages from correction and equivalence queries Cătălin Ionuţ Tîrnăucă Research Group on Mathematical Linguistics, Rovira i Virgili.
Finite Automata Great Theoretical Ideas In Computer Science Victor Adamchik Danny Sleator CS Spring 2010 Lecture 20Mar 30, 2010Carnegie Mellon.
CSCI 4325 / 6339 Theory of Computation Zhixiang Chen.
Nonregular Languages How do you prove a language to be regular? How do you prove a language to be nonregular? A Pumping Lemma.
Equivalence with FA * Any Regex can be converted to FA and vice versa, because: * Regex and FA are equivalent in their descriptive power ** Regular language.
1 A well-parenthesized string is a string with the same number of (‘s as )’s which has the property that every prefix of the string has at least as many.
Theory of Computational Complexity TA : Junichi Teruyama Iwama lab. D3
1 Advanced Theory of Computation Finite Automata with output Pumping Lemma Theorem.
Nonregular Languages Section 2.4 Wed, Oct 5, 2005.
Non-regular languages
Standard Representations of Regular Languages
CSE322 PUMPING LEMMA FOR REGULAR SETS AND ITS APPLICATIONS
Nonregular Languages Section 2.4 Wed, Oct 5, 2005.
Infiniteness Test The Pumping Lemma Nonregular Languages
More on DFA minimization and DFA equivalence
Elementary Questions about Regular Languages
Non-regular languages
Chapter 1 Regular Language - 02
More Applications of the Pumping Lemma
Instructor: Aaron Roth
CSCI 2670 Introduction to Theory of Computing
CSCI 2670 Introduction to Theory of Computing
Finite Automata Fall 2018.
Presentation transcript:

The Power of Correction Queries Cristina Bibire Research Group on Mathematical Linguistics, Rovira i Virgili University Pl. Imperial Tarraco 1, 43005, Tarragona, Spain Pl. Imperial Tarraco 1, 43005, Tarragona, Spain 9 th of February 2006 Seminar V

Outline  Introduction  A class which makes the difference  Practical results  The injectivity property  Future Work

Introduction The correcting string of s in the language L is the smallest string s ' (in lex-length order) such that s.s ' belongs to L. The answer to a correction query for a string consists of its correcting string. Myhill-Nerode theorem: The number of states in the smallest DFA accepting L is equal to the number of equivalence classes in.

Introduction Definition By the number of MQs a language require in order to be identified we understand how many different strings are submitted by the learner L* to the teacher until it outputs the target language. Note that each string is counted only once: even if the algorithm reaches a point where the learner should submit to the teacher a string which was previously submitted we will not count this as another MQ. Definition By the number of CQs a language require in order to be identified we understand how many different strings are submitted by the learner LCA to the teacher until it outputs the target language. In this case, not only we do not count twice the same string, but the learner LCA can also obtain some implicit answers. Therefore, the algorithm does not ask these questions and we do not count them as new CQs.

A class which makes the difference Theorem There exists an infinite class of languages which requires a polynomial number of MQs but a linear number of CQs in order to be identified.

A class which makes the difference Theorem There exists an infinite class of languages which requires a polynomial number of MQs but a linear number of CQs in order to be identified. Let us consider the class of singletons over.

A class which makes the difference Theorem There exists an infinite class of languages which requires a polynomial number of MQs but a linear number of CQs in order to be identified. Let us consider the class of singletons over. Lemma 1. For any fixed alphabet of length and any language L in, the number of MQs needed by L* in order to identify L is: where m is the size of the minimal DFA accepting L. Lemma 2. For any fixed alphabet of length and any language L in, the number of CQs needed by LCA in order to identify L is: where m is the size of the minimal DFA accepting L.

A class which makes the difference If n is the length of the unique string in L, then:

A class which makes the difference If n is the length of the unique string in L, then:

A class which makes the difference If n is the length of the unique string in L, then:

Practical Results

The injectivity property For any regular language L, we say that it has the injectivity property if for every two strings s and s',

The injectivity property For any regular language L, we say that it has the injectivity property if for every two strings s and s', Theorem Let L be a regular language. If L has the injectivity property then the number of CQs is at most meanwhile the number of MQs is at least, where k is the size of the alphabet and n the number of states of the minimal DFA accepting L.

The injectivity property For any regular language L, we say that it has the injectivity property if for every two strings s and s', Theorem Let L be a regular language. If L has the injectivity property then the number of CQs is at most meanwhile the number of MQs is at least, where k is the size of the alphabet and n the number of states of the minimal DFA accepting L. Proof

The injectivity property For any regular language L, we say that it has the injectivity property if for every two strings s and s', Theorem Let L be a regular language. If L has the injectivity property then the number of CQs is at most meanwhile the number of MQs is at least, where k is the size of the alphabet and n the number of states of the minimal DFA accepting L. Proof

The injectivity property Proofλ s 1 s 2... s n c1c1c2c2cncnc1c1c2c2cncn s 1 a 1... s 1 a k... s n a k S SΣ-S E

The injectivity property Proofλ s 1 s 2... s n c1c1c2c2cncnc1c1c2c2cncn s 1 a 1... s 1 a k... s n a k S SΣ-S E

The injectivity property Proofλ s 1 s 2... s n c1c1c2c2cncnc1c1c2c2cncn s 1 a 1... s 1 a k... s n a k S SΣ-S E

The injectivity property Proofλ s 1 s 2... s n c1c1c2c2cncnc1c1c2c2cncn s 1 a 1... s 1 a k... s n a k S SΣ-S E

Future Work  The injectivity property: - Find a proper upper bound for the number of MQs (polynomial?) - Find a mathematical relation between the degree of injectivity and the reducing factor (MQ/CQ)  Other classes of languages: - Classes of languages learnable from positive examples (finite thickness, finite elasticity, characteristic sample) or not (finite tell tale) - The class of k-reversible languages - Others ?