Syntax LING 001 - October 11, 2006 Joshua Tauberer.

Slides:



Advertisements
Similar presentations
Chapter 4 Syntax Part IV.
Advertisements

The Structure of Sentences Asian 401
SYNTAX 4 DAY 33 – NOV 13, 2013 Brain & Language LING NSCI Harry Howard Tulane University.
Constituency Lec. 5.
Syntax. Definition: a set of rules that govern how words are combined to form longer strings of meaning meaning like sentences.
FSG, RegEx, and CFG Chapter 2 Of Sag’s Syntactic Theory.
1 Introduction to Linguistics II Ling 2-121C, group b Lecture 4 Eleni Miltsakaki AUTH Spring 2006.
Statistical NLP: Lecture 3
Adapted from My Dog Bites the English Teacher, by Marian Anders.
SYNTAX Introduction to Linguistics. BASIC IDEAS What is a sentence? A string of random words? If it is a sentence, does it have to be meaningful?
MORPHOLOGY - morphemes are the building blocks that make up words.
Introduction and Jurafsky Model Resource: A Probabilistic Model of Lexical and Syntactic Access and Disambiguation, Jurafsky 1996.
Matakuliah: G0922/Introduction to Linguistics Tahun: 2008 Session 11 Syntax 2.
Matakuliah: G0922/Introduction to Linguistics Tahun: 2008 Session 10 Syntax 1.
1 CSC 594 Topics in AI – Applied Natural Language Processing Fall 2009/ Outline of English Syntax.
Dr. Ansa Hameed Syntax (4).
Syntax: The analysis of sentence structure
Syntax.
The syntax of language How do we form sentences? Processing syntax. Language and the brain.
Constituency Tests Phrase Structure Rules
Syntax Nuha AlWadaani.
THE PARTS OF SYNTAX Don’t worry, it’s just a phrase ELL113 Week 4.
Phrases and Sentences: Grammar
LI 2013 NATHALIE F. MARTIN S YNTAX. Grammatical vs Ungrammatical.
1 LIN 1310B Introduction to Linguistics Prof: Nikolay Slavkov TA: Qinghua Tang CLASS 14, Feb 27, 2007.
Introduction to Linguistics
Syntax.
Natural Language Processing Lecture 6 : Revision.
Chapter 12: FORMAL GRAMMARS OF ENGLISH Heshaam Faili University of Tehran.
Syntax 1 st class on Syntax Chapter 4. Hierarchical Structure  Sentences have internal structure that makes them more than just a sequence of words.
CSNB143 – Discrete Structure Topic 11 – Language.
NLP. Introduction to NLP Is language more than just a “bag of words”? Grammatical rules apply to categories and groups of words, not individual words.
Today Phrase structure rules, trees Constituents Recursion Conjunction
Parsing and Syntax. Syntactic Formalisms: Historic Perspective “Syntax” comes from Greek word “syntaxis”, meaning “setting out together or arrangement”
1 Prof.Roseline WEEK-4 LECTURE -4 SYNTAX. 2 Prof.Roseline Syntax Concentrate on the structure and ordering of components within a sentence Greater focus.
For Wednesday Read chapter 23 Homework: –Chapter 22, exercises 1,4, 7, and 14.
Linguistic Essentials
Parsing with Context-Free Grammars for ASR Julia Hirschberg CS 4706 Slides with contributions from Owen Rambow, Kathy McKeown, Dan Jurafsky and James Martin.
Review of basic concepts.  The knowledge of sentences and their structure.  Syntactic rules include: ◦ The grammaticality of sentences ◦ Word order.
Rules, Movement, Ambiguity
The man bites the dog man bites the dog bites the dog the dog dog Parse Tree NP A N the man bites the dog V N NP S VP A 1. Sentence  noun-phrase verb-phrase.
CSA2050 Introduction to Computational Linguistics Parsing I.
1 Context Free Grammars October Syntactic Grammaticality Doesn’t depend on Having heard the sentence before The sentence being true –I saw a unicorn.
Natural Language Processing
Making it stick together…
SYNTAX.
English Syntax Read J & M Chapter 9.. Two Kinds of Issues Linguistic – what are the facts about language? The rules of syntax (grammar) Algorithmic –
3 Phonology: Speech Sounds as a System No language has all the speech sounds possible in human languages; each language contains a selection of the possible.
◦ Process of describing the structure of phrases and sentences Chapter 8 - Phrases and sentences: grammar1.
SYNTAX 1 NOV 9, 2015 – DAY 31 Brain & Language LING NSCI Fall 2015.
1 Chapter 4 Syntax Part III. 2 The infinity of language pp The number of sentences in a language is infinite. 2. The length of sentences is.
CSA3050: NLP Algorithms Sentence Grammar NLP Algorithms.
Syntax By WJQ. Syntax : Syntax is the study of the rules governing the way words are combined to form sentences in a language, or simply, the study of.
Grammar The structure of sentences Kuiper and Allan Chapter 7.
Grammar 101 How to be awesome. Clauses A clause has a subject/verb form. A subject is who or what is doing the stuff. A verb is what is being done by.
Week 3. Clauses and Trees English Syntax. Trees and constituency A sentence has a hierarchical structure Constituents can have constituents of their own.
Week 2. Constituents Sentences can be analyzed into subparts which we referred to as constituents English Syntax.
King Faisal University جامعة الملك فيصل Deanship of E-Learning and Distance Education عمادة التعلم الإلكتروني والتعليم عن بعد [ ] 1 King Faisal University.
Statistical NLP: Lecture 3
Basic Parsing with Context Free Grammars Chapter 13
SYNTAX.
Chapter Eight Syntax.
Part I: Basics and Constituency
CS : Speech, NLP and the Web/Topics in AI
Syntax.
Chapter Eight Syntax.
Introduction to Linguistics
Linguistic Essentials
Parts of sentence & word order in English
Presentation transcript:

Syntax LING October 11, 2006 Joshua Tauberer

Syntax How can the words of a language be put together?

Syntax What makes a valid combination or order of words? What are the relations between the words in a sentence? What is the mechanical system by which we put words together?

Sentence or Word Salad? good students take a linguistics course students linguistics course good a take students good take a course linguistics take students course good linguistics a good students a linguistics course take

Sentence or Word Salad? ✓ good students take a linguistics course * students linguistics course good a take * students good take a course linguistics * take students course good linguistics a * good students a linguistics course take

Sentence or Word Salad? ✓ good students take a linguistics course * students linguistics course good a take * students good take a course linguistics ~ Romance languages * take students course good linguistics a * good students linguistics course a take ~ Japanese, Turkish

Sentence or Word Salad? Sometimes rearranging the words yields word salad. Sometimes rearranging the words gives a different meaning.  John likes Mary.  Mary likes John. Sometimes one arrangement has two meanings  I saw the man with a telescope.  Is this syntax or semantics?

What’s a valid sentence? verb noun verb noun verb noun

What’s a valid sentence? verbLeave! noun verbI ate. noun verb nounStudents like linguistics.

What’s a valid sentence? verbLeave! noun verbI ate. noun verb nounStudents like linguistics. noun verb noun preposition determiner noun Billy sent letters to his mom. noun verb det noun noun verb Sally found the gold I burried. and on...

What’s not a sentence? *noun *noun noun verb verb determiner *noun adjective det det noun adjective verb

What’s a valid sentence? Can we list all valid POS strings?  Is there a longest sentence? Language is unbounded in many ways  coordinationX and Y and Z and...  modifiersin the house on the table...  recursionwho chased the dog that ate the... We need a finite set of rules (the grammar) that gives us an infinite set of strings (the language).

Two Models of Syntax Words as Building Blocks Constituent Structure

Words as Building Blocks A model of syntax: (loosely based on Tree Adjoining Grammar) The mind’s vocabulary comprises a set (lexicon) of special domino-puzzle pieces. noun S verb adj prep verb prep

Words as Building Blocks Assemble the pieces any way so that there are no bumps or holes at the end. Colors must match like dominos. Start with the special S piece. Bill ate S cake read words from left to right (actually “infix order”) the mechanical system

Words as Building Blocks Bill ate S cake some

Words as Building Blocks ate S store the Billcake from

Words as Building Blocks S store the ate Billcake from

Words as Building Blocks S store the ate Billcake from

Words as Building Blocks S cakestore the ate Bill from

Words as Building Blocks Bill S cakestore the ate from

Words as Building Blocks Bill S cakestore the ate from

Words as Building Blocks The way the pieces connect tell us how the words are related. The organization of pieces tells us about the meaning. Bill ate S cake

John likes S Mary Words as Building Blocks The organization of pieces tells us about the meaning. This bump is for the subject. This bump is for the object. Mary likes S John

I S saw a with man a tele- scope How many ways are there two assemble the pieces to make the sentence? with

manI S a tele- scope saw a manI S a tele- scope saw a with Prepositional Phrase Attachment

manI S a tele- scope saw a manI S a tele- scope saw a with “Infix Order”

manI S a tele- scope saw a manI S a tele- scope saw a with “Infix Order”

manI S a tele- scope saw a manI S a tele- scope saw a with “Infix Order”

manI S a tele- scope saw a manI S a tele- scope saw a with “Infix Order” I

manI S a tele- scope saw a manI S a tele- scope saw a with “Infix Order” I saw

manI S a tele- scope saw a manI S a tele- scope saw a with “Infix Order” I saw

manI S a tele- scope saw a manI S a tele- scope saw a with “Infix Order” I saw

manI S a tele- scope saw a manI S a tele- scope saw a with “Infix Order” I saw a

manI S a tele- scope saw a manI S a tele- scope saw a with “Infix Order” I saw a man

manI S a tele- scope saw a manI S a tele- scope saw a with “Infix Order” I saw a man

manI S a tele- scope saw a manI S a tele- scope saw a with “Infix Order” I saw a man

manI S a tele- scope saw a manI S a tele- scope saw a with “Infix Order” I saw a man with

manI S a tele- scope saw a manI S a tele- scope saw a with “Infix Order” I saw a man with a

manI S a tele- scope saw a manI S a tele- scope saw a with “Infix Order” I saw a man with a telescope

Garden Path Sentences The horse raced past the barn fell. Grammatical?

Garden Path Sentences More from Wikipedia:  The man who hunts ducks out on weekends.  The cotton clothing is usually made of grows in Mississippi.  The old man the boat.  The player kicked the ball kicked the ball.

Garden Path Sentences horse S the past barn fell the ? raced

Garden Path Sentences horse the past barn fell the raced S

Garden Path Sentences horse S the past barn fell the raced

Garden Path Sentences horse S the past barn fell the raced

Garden Path Sentences horse S the past barn fell the raced

Garden Path Sentences horse S past barn fell the raced The horse (that was) raced past the barn fell. the The yellow ‘raced’ piece is used for relative clauses.

Garden Path Sentences More from Wikipedia:  The man [who hunts] [ducks out on weekends].  The cotton (that) clothing is usually made of grows in Mississippi.  [The old] [man the boat].  The player (that was) kicked the ball kicked the ball.

Constituency and Substitution A second perspective on syntax. Sentences seem to have replaceable parts. Billy ate peaches from the store Billy ate cookies from the store Billy ate the pie from the store Billy ate the pie in the box Billy ate the pie on the box Billy sold the pie on the table the store sold the pie on the table

Constituency and Substitution But parts can’t be replaced with just anything. Billy ate peaches from the store Billy ate sold from the store on the table ate peaches from the store Billy ate peaches the pie Just as words are categorized by part of speech, replaceable parts (“constituents”/ phrases) come in different types.

Constituency and Substitution Billy ate the pie from the store nouns = { pie, cookies, store, table, Billy } verbs = { ate, sold } prepositions = { from, in, on } noun phrases = { cookies, the pie } prepositional phrases = { from the store, in the box, on the table, just until the clock struck seven }

Constituency and Substitution Billy ate the pie from the store nouns = { pie, cookies, store, table, Billy } verbs = { ate, sold } prepositions = { from, in, on } noun phrases = { nouns, det + nouns } prepositional phrases = { preposition + noun phrases } determiner = article (‘the’, ‘a’)

Context Free Grammar Let’s say a sentence (S) is defined by a rule: NounPhrase Verb NounPhrase And a NounPhrase is defined as either:  Noun or  Determiner Noun Keep substituting symbols with other constituents of the same category until only words in the language remain.

Context Free Grammar S NounPhrase Verb NounPhrase Noun ate Determiner Noun Billy ate the cookies

Context Free Grammar S NounPhrase Verb NounPhrase Determiner Noun has Determiner Noun the store has the pie

Context Free Grammar Trees show order symbols were replaced. Also shows the constituent structure.

Context Free Grammar

Recursion Billy eats worms Ruthy made Billy eat worms The teacher let Ruthy make Billy eat worms I saw the teacher let Ruthy make Billy eat worms The principle knows I saw the teacher let Ruthy make Billy eat worms The superintendent wonders whether the principle knows I saw the teacher let Ruthy make Billy eat worms

Recursion S NP Verb S NP let S Det Noun let S the teacher let S the teacher let Noun Verb S the teacher let Ruthy make S the teacher let Ruthy make Noun Verb Noun the teacher let Ruthy make Billy eat worms

Recursion

verb

Recursion

PP Attachment with Trees How is PP-attachment ambiguity represented with trees? Let’s define a Prepositional Phrase first:  S → NP Verb NP  NP → Det Noun  PP → Prep NP Recursively define S’s and NP’s.  S → S PP  NP → NP PP “Any valid S/NP can have a PP tacked on and still be a valid S/NP.”

PP Attachment with Trees