Computational Intelligence 696i Language Lecture 4 Sandiway Fong.

Slides:



Advertisements
Similar presentations
Review of Homework 4 November 20, Exercise 1 (A) 1 pt Modify the DCG to accept the omission of the complementizer that for object relative clauses.
Advertisements

07/05/2005CSA2050: DCG31 CSA2050 Introduction to Computational Linguistics Lecture DCG3 Handling Subcategorisation Handling Relative Clauses.
LING/C SC/PSYC 438/538 Lecture 22 Sandiway Fong 1.
LING 388: Language and Computers Sandiway Fong Lecture 2.
Long Distance Dependencies (Filler-Gap Constructions) and Relative Clauses October 10, : Grammars and Lexicons Lori Levin (Examples from Kroeger.
Linguistic Theory Lecture 7 About Nothing. Nothing in grammar Language often contains irregular paradigms where one or more expected forms are absent.
1 Introduction to Linguistics II Ling 2-121C, group b Lecture 4 Eleni Miltsakaki AUTH Spring 2006.
Week 3a. UG and L2A: Background, principles, parameters CAS LX 400 Second Language Acquisition.
Lecture 11: Binding and Reflexivity.  Pronouns differ from nouns in that their reference is determined in context  The reference of the word dog is.
PSY 369: Psycholinguistics Some basic linguistic theory part2.
Phrase Structure Rules Must allow all and only the grammatical sentences in a language Descriptive rules, not necessarily prescriptive Each rule “rewrites”
Section 4: Language and Intelligence Overview Instructor: Sandiway Fong Department of Linguistics Department of Computer Science.
LING 388: Language and Computers Sandiway Fong Lecture 15.
Linguistic Theory Lecture 8 Meaning and Grammar. A brief history In classical and traditional grammar not much distinction was made between grammar and.
Week 5a. Binding theory CAS LX 522 Syntax I. Structural ambiguity John said that Bill slipped in the kitchen. John said that Bill slipped in the kitchen.
LING 364: Introduction to Formal Semantics Lecture 4 January 24th.
Computational Intelligence 696i Language Lecture 3 Sandiway Fong.
Computational Intelligence 696i Language Lecture 5 Sandiway Fong.
Computational Intelligence 696i Language Lecture 2 Sandiway Fong.
LING 388 Language and Computers Take-Home Final Examination 12/9/03 Sandiway FONG.
LING 388 Language and Computers Lecture 18 10/30/03 Sandiway FONG.
1 Introduction to Computational Natural Language Learning Linguistics (Under: Topics in Natural Language Processing ) Computer Science (Under:
Computational Intelligence 696i Language Lecture 1 Sandiway Fong.
LING 388: Language and Computers Sandiway Fong Lecture 1: 8/23.
Week 14b. PRO and control CAS LX 522 Syntax I. It is likely… This satisfies the EPP in both clauses. The main clause has Mary in SpecIP. The embedded.
LING 364: Introduction to Formal Semantics Lecture 5 January 26th.
CAS LX 522 Syntax I Week 11a. Wh-movement.
Linguistic Theory Lecture 3 Movement. A brief history of movement Movements as ‘special rules’ proposed to capture facts that phrase structure rules cannot.
LING/C SC/PSYC 438/538 Lecture 2 Sandiway Fong. Today’s Topics Did you read Chapter 1 of JM? – Short Homework 1 (submit by midnight Saturday) Some slides.
1 LIN 1310B Introduction to Linguistics Prof: Nikolay Slavkov TA: Qinghua Tang CLASS 14, Feb 27, 2007.
LING 696G Computational Linguistics Seminar Lecture 2 2/2/04.
LING 388: Language and Computers Sandiway Fong Lecture 3.
1 Syntax 1 Homework to be handed in on 19th or 26th December: Fromkin morphology exercises 6, 7, & 14. Also, do either 8 or 9, and only one of 15, 16 or.
THE BIG PICTURE Basic Assumptions Linguistics is the empirical science that studies language (or linguistic behavior) Linguistics proposes theories (models)
LING 388: Language and Computers Sandiway Fong Lecture 18.
Linguistic Theory Lecture 10 Grammaticality. How do grammars determine what is grammatical? 1 st idea (traditional – 1970): 1 st idea (traditional – 1970):
1 Syntax 1 Homework to be handed in on 19th or 26th December: Fromkin morphology exercises 6, 7, & 14. Also, do either 8 or 9, and only one of 15, 16 or.
LING 388: Language and Computers Sandiway Fong Lecture 10.
LING 388: Language and Computers Sandiway Fong Lecture 19.
1 LIN 1310B Introduction to Linguistics Prof: Nikolay Slavkov TA: Qinghua Tang CLASS 24, April 3, 2007.
LING 388: Language and Computers Sandiway Fong Lecture 13.
LING 388: Language and Computers Sandiway Fong Lecture 1: 8/23.
1 Syntax 2 Essays: deadline extended to Monday 2nd, but must be printed on paper. ed essays must still arrive by 30th. Morphology homework by 26th.
Culture , Language and Communication
LING 388: Language and Computers Sandiway Fong Lecture 12.
Rules, Movement, Ambiguity
November 16, 2004 Lexicon (An Interacting Subsystem in UG) Part-II Rajat Kumar Mohanty IIT Bombay.
1 Syntax 1. 2 In your free time Look at the diagram again, and try to understand it. Phonetics Phonology Sounds of language Linguistics Grammar MorphologySyntax.
SYNTAX.
Lecture 1: Trace Theory.  We have seen that things move :  Arguments move out of the VP into subject position  Wh-phrases move out of IP into CP 
1 Some English Constructions Transformational Framework October 2, 2012 Lecture 7.
LING 388: Language and Computers Sandiway Fong Lecture 20.
1 LIN 1310B Introduction to Linguistics Prof: Nikolay Slavkov TA: Qinghua Tang CLASS 11, Feb 9, 2007.
1 Principles & Parameters Approach in Linguistics II Bibhuti Bhusan Mahapatra.
NLP. Introduction to NLP #include int main() { int n, reverse = 0; printf("Enter a number to reverse\n"); scanf("%d",&n); while (n != 0) { reverse =
Computational Intelligence 696i Language Homework 1 Answers Sandiway Fong.
Syntax By WJQ. Syntax : Syntax is the study of the rules governing the way words are combined to form sentences in a language, or simply, the study of.
Week 3. Clauses and Trees English Syntax. Trees and constituency A sentence has a hierarchical structure Constituents can have constituents of their own.
King Faisal University جامعة الملك فيصل Deanship of E-Learning and Distance Education عمادة التعلم الإلكتروني والتعليم عن بعد [ ] 1 King Faisal University.
Linguistics 1 Syntax Week 2 Lectures 3 & 4.
Week 3b. Merge, feature checking
English Syntax Week 1. Introduction.
Syntax 1.
SYNTAX.
Part I: Basics and Constituency
Language Variations: Japanese and English
Binding theory.
Linguistic aspects of interlanguage
Principles and Parameters (I)
Lecture 7: Definite Clause Grammars
Presentation transcript:

Computational Intelligence 696i Language Lecture 4 Sandiway Fong

Administriva Homework 1 out today –reviewed in class today so ask clarification questions! –due one week from today –submit to

Last Time –we talked about the paradigm shift from “rule-based” systems to the principles- and-parameters (P&P) framework –the idea that we have UG, a system with some amount of pre-wiring + learning mechanism (including parameter setting)

Principles-and-Parameters a system of interacting sub-modules ECP Theta Move-α Binding

Today’s Lecture goal is to get you familiarized with PAPPI, a principles-and-parameters (P&P) parser –representing one possible instantiation of UG –universal part a set of 20–30 principles –language-particular part parameters settings instantiated for SVO, SOV, V2 languages small lexicons for a certain number of languages –Turkish, Hungarian, Chinese, Japanese, Dutch, German, French, Spanish, Bangla, English –system is a parser only there is no learning mechanism

Today’s Lecture Gotta get through 3 things today... 1.explain the demo 2.do one exercise 3.present the homework Reading (optional) for discussion next time: –latest thinking on language and linguistic theory –download and read 1st 5–6 pages of –On Phases by N. Chomsky (m.s. 2005) –

Part (1)

Demo description available on webpage – html#test example of how UG might be instantiated –one set of principles –three languages English: SVO Japanese: SOV Dutch: V2-language –verb is 2nd phrase (roughly resembles SVO), –but in embedded clauses verb comes last (SOV)

Demo: English Example: –Which report did you file without reading? Word Order: –SVO Structure: –Which report did you file [the report] without [you] reading [the report]? –Which report[1] did [ S you[2] [ VP file NPt[1]] [ without [ S NP[2] [ VP reading NP[1]]]]]? Notes: –NP indicates noun phrase e-element –trace indicated by t –indices, e.g. [1], are used for coindexation

Demo: English

Example: –*Who does Mary wonder why John hit? Ungrammatical –violates principle of subjacency can’t displace too far in one hop However, you can still recover the meaning... –so it’s (considered) a mild violation Underlying structure: –Mary wonders why John hit who –Who does Mary wonders why John hit trace Explanation: –interaction with X’-theory: –no intermediate position available as a landing site –cf. Who does Mary think John hit?

Demo: English

Demo: Japanese Example: –neko-ga koroshita nezumi-ga tabeta tiizu-wa kusatte ita –cat-NOM killed rat-NOM ate cheese-TOP rotten was –the cheese the rat the cat killed ate was rotten Word Order: –SOV Center-embedding (English) –[the cheese [the rat [the cat killed] ate] was rotten] –resource limitation Left-embedding (Japanese) –[cat killed] [rat ate] [cheese was rotten] –no resource limitation

Demo: Japanese

Demo: Dutch Example: –Ik weet dat Hanneke haar oma bezocht –I know that Hanneke her grandma visited –I know that Hanneke visited her Grandma V2 word order: –[ S Ik weet [ S dat Hanneke haar oma bezocht ]] Pronoun binding ambiguity –whose grandma? –same ambiguity in Dutch as in English –determined by the rules of pronoun binding

Demo: Dutch [3] ≠[5]

Demo: Dutch [3] = [3]

Part (2)

Using PAPPI description available on –Introduction to the Theory of PAPPI osx/pgap.html how to use PAPPI to see what UG is doing –you will do a very similar exercise for homework 1 let’s look at the parasitic gap sentence again which report did you file without reading? –and look at Move-alpha (displacement property)

Using PAPPI Example: which report did you file without reading? Move-alpha (displacement property) –you filed which report without reading –which report did you file trace without reading Why isn’t it? –you filed without reading which report –which report did you file trace without reading trace Why isn’t it? –you filed without reading which report –which report did you file without reading trace What rules out these derivation? –PAPPI considers all possible derivations

PAPPI: Computation think of derivations running a gauntlet of constraints and only the grammatical ones make it

PAPPI: Computation 47 structures 1 admitted 46 ruled out including –which report did you file trace without reading trace –which report did you file without reading trace

PAPPI: Computation Why isn’t it? –you filed without reading which report –which report did you file trace without reading trace This is tree #8 out of 47 –look at the chain feature –chain(NP[1],Type,Path) Type = {head, medial, last} Path = list of intermediate nodes to antecedent

PAPPI: Computation Idea: isolate tree #8 and see what blocks it

PAPPI: Computation What blocks a derivation? –a principle that when turned off allows a parse to be generated –[this is not necessarily the same as the stopping principle reported by the parser] Let’s test this on #8... –Case Condition on Traces (reported) –Theta Criterion

Part (3)

Homework 1 Minimal Pair: –(1) a. John is too stubborn to talk to – b. John is too stubborn to talk to Bill It’s an interesting example: –just adding one word Bill provokes a big change in gap-filling PAPPI parses: –(2) a. John[1] is too stubborn Op[1] PRO[2] to talk to t[1] – b. John[1] is too stubborn PRO[1] to talk to Bill[2] Readings: –(3) a. John is too stubborn for some arbitrary person to talk to John – b. John is too stubborn for John to talk to Bill

Homework 1 Question 1: 2pts (giveaway) –how many structures did it consider for each sentence? Question 2: (6pts) –Consider the sentence: (4) John is too stubborn [for John] to talk to himself PAPPI parses both versions of this sentence why is this interpretation unavailable for (1a)? –what principle(s) rules it out? –your answer should report which parse numbers and the steps required to drill down to the answer Question 3: (4 pts) –Think of another example of a minimal pair where the interpretation of a gap in terms of reference must change when a noun (or preposition+noun) is added