1 Words and rules Linguistics lecture #2 October 31, 2006.

Slides:



Advertisements
Similar presentations
 Christel Kemke 2007/08 COMP 4060 Natural Language Processing Feature Structures and Unification.
Advertisements

Language and Cognition Colombo, June 2011 Day 2 Introduction to Linguistic Theory, Part 4.
1 Introduction to Linguistics II Ling 2-121C, group b Lecture 4 Eleni Miltsakaki AUTH Spring 2006.
1 Language and kids Linguistics lecture #8 November 21, 2006.
PSY 369: Psycholinguistics Some basic linguistic theory part2.
MORPHOLOGY - morphemes are the building blocks that make up words.
Natural Language Processing - Feature Structures - Feature Structures and Unification.
Cognitive Processes PSY 334 Chapter 11 – Language Structure.
What is Syntax?  The rules that govern the structure of utterances; also called grammar  The basic organization of sentences is around syntax  build.
 Christel Kemke 2007/08 COMP 4060 Natural Language Processing Feature Structures and Unification.
Lect. 11Phrase structure rules Learning objectives: To define phrase structure rules To learn the forms of phrase structure rules To compose new sentences.
Today  What is syntax?  Grammaticality  Ambiguity  Phrase structure Readings: 6.1 – 6.2.
TRANSFORMATIONAL GRAMMAR An introduction. LINGUISTICS Linguistics Traditional Before 1930 Structural 40s -50s Transformational ((Chomsky 1957.
The students will be able to know:
Dr. Ansa Hameed Syntax (4).
Syntax: The analysis of sentence structure
Syntax.
Lecture 1 Introduction: Linguistic Theory and Theories
Generative Grammar(Part ii)
Constituency Tests Phrase Structure Rules
Syntax Nuha AlWadaani.
Phonetics, Phonology, Morphology and Syntax
THE PARTS OF SYNTAX Don’t worry, it’s just a phrase ELL113 Week 4.
Three Generative grammars
Language and Culture Prof. R. Hickey SoSe 2006 How language works
Phonological Rules Rules about how sounds may or may not go together in a language English: Words may not start with two stop consonants German: Devoicing.
Creativity of Language
1 Language genes and evolution Linguistics lecture #10 November 28, 2006.
1 What does “meaning” mean? Linguistics lecture #3 November 2, 2006.
1. Information Conveyed by Speech 2. How Speech Fits in with the Overall Structure of Language TWO TOPICS.
1 Syntax 1 Homework to be handed in on 19th or 26th December: Fromkin morphology exercises 6, 7, & 14. Also, do either 8 or 9, and only one of 15, 16 or.
Grammar: An Introduction Definitions, historical overview, dynamic nature.
GRAMMARS David Kauchak CS159 – Fall 2014 some slides adapted from Ray Mooney.
1 Language processing in the mind Linguistics lecture #5 November 9, 2006.
1 Syntax 1 Homework to be handed in on 19th or 26th December: Fromkin morphology exercises 6, 7, & 14. Also, do either 8 or 9, and only one of 15, 16 or.
CSNB143 – Discrete Structure Topic 11 – Language.
Notes on Pinker ch.7 Grammar, parsing, meaning. What is a grammar? A grammar is a code or function that is a database specifying what kind of sounds correspond.
1 Prof.Roseline WEEK-4 LECTURE -4 SYNTAX. 2 Prof.Roseline Syntax Concentrate on the structure and ordering of components within a sentence Greater focus.
Culture , Language and Communication
Parsing with Context-Free Grammars for ASR Julia Hirschberg CS 4706 Slides with contributions from Owen Rambow, Kathy McKeown, Dan Jurafsky and James Martin.
Rules, Movement, Ambiguity
Artificial Intelligence: Natural Language
1 Context Free Grammars October Syntactic Grammaticality Doesn’t depend on Having heard the sentence before The sentence being true –I saw a unicorn.
1 LIN 1310B Introduction to Linguistics Prof: Nikolay Slavkov TA: Qinghua Tang CLASS 16, March 6, 2007.
Introduction Chapter 1 Foundations of statistical natural language processing.
1 Syntax 2. 2 Now let’s change the NP rule again Such that we have – S  NP VP – VP  V NP – NP  (DET) (ADJ) N Now you can diagram this sentence – The.
Syntax II “I really do not know that anything has ever been more exciting than diagramming sentences.” --Gertrude Stein.
1 Syntax 1. 2 In your free time Look at the diagram again, and try to understand it. Phonetics Phonology Sounds of language Linguistics Grammar MorphologySyntax.
◦ Process of describing the structure of phrases and sentences Chapter 8 - Phrases and sentences: grammar1.
1 Some English Constructions Transformational Framework October 2, 2012 Lecture 7.
Language and Cognition Colombo, June 2011 Day 2 Introduction to Linguistic Theory, Part 3.
What is the nature of language? Characteristics of human language Language acquisition Empiricism and nativism Language structure Deep and surface structures.
NATURAL LANGUAGE PROCESSING
College of Science and Humanity Studies, Al-Kharj.
Lecturer : Ms. Abrar Mujaddidi S YNTAX. I NTRODUCTION  In the previous chapter, we moved from the general categories and concepts of traditional grammar,
SYNTAX.
King Faisal University جامعة الملك فيصل Deanship of E-Learning and Distance Education عمادة التعلم الإلكتروني والتعليم عن بعد [ ] 1 King Faisal University.
Syntax 2.
Syntax 1.
Beginning Syntax Linda Thomas
Syntax Word order, constituency
SYNTAX.
4.3 The Generative Approach
Chapter Eight Syntax.
Syntax.
What is Syntax?  The rules that govern the structure of utterances; also called grammar  The basic organization of sentences is around syntax  build.
BBI 3212 ENGLISH SYNTAX AND MORPHOLOGY
Chapter Eight Syntax.
Introduction to Linguistics
Traditional Grammar VS. Generative Grammar
Presentation transcript:

1 Words and rules Linguistics lecture #2 October 31, 2006

2 Overview The atoms of language (words) How grammar works The grammar of sentences (syntax)

3 Words are amazing Words are symbols: they represent things, rather than being associated with things. 今天太冷 … 不是,太熱。 This common kind of mistake shows that words are linked to symbolic forms in the mind, not physical sensations (e.g. HOT = NOT_COLD)

4 Words are amazing Words are memorized, but people are amazingly good at memorizing them Children learn about 8 new words every day! Adults (whether English or Chinese speakers) know about 60,000 words!!! Chimpanzees can be trained to use at most 180 words (but do they really use them symbolically, and in the correct form?)

5 Is the word learning ability innate? Philosopher W. V. O. Quine supported behaviorism, and at first thought that words could be learned purely by association. RABBIT Problem: How do we know what to associate with what?

6 The “gavagai” problem Your native guide points to a rabbit and says “gavagai”. What does “gavagai” mean? GAVAGAI!

7 Words act like atoms Words act like atoms in sentences: fundamental units that can be combined in different ways without changing their memorized value. The dog bit the man The man bit the dog

8 Atoms are combined by rules Not every combination is grammatical (ungrammatical items are marked *) The dog bit the man The man bit the dog *The bit man the dog *Man the bit dog the

9 Syntactic classes are syntactic Nouns and verbs are defined by their syntactic behavior, not by their meaning James likes to do research on language.(noun) James likes to research language.(verb)

10 Syntactic rules Syntactic rules not only refer to classes, but also refer to structure (1)a.The boy is eating. b.Is the boy eating? Structure-free rule (WRONG): Move the first IS (2)a.The boy who is here is eating. b.*Is the boy who here is eating? c.Is the boy who is here eating? Structure-based rule: Move the “main” IS

11 Syntactic structure If there is no syntactic structure, words could just be put together in a chain 那狗我隻和愛。這貓你那狗我隻和愛。這貓你

12 Problems with chain hypothesis Word-by-word associations  grammatical Colorless green ideas sleep furiously Long-distance dependencies: words can depend on each other even if far apart. 那隻很可愛的狗愛我。 那個很可愛的人愛你。

13 Syntactic rules Since Chomsky (1957), most linguists believe that there are two basic kinds of syntactic rules rules that build sentence structure rules that change sentence structure

14 Building sentence structure The boy who is here is eating [[The boy [who [is here]]] [is eating]]

15 How do we know trees exist? Meaning is affected by syntactic structure 漂亮 的 小鳥 的 蛋 an egg of a beautiful bird a beautiful egg of a bird

16 How do we know trees exist? Other tests don’t refer to meaning It’s easier to pause between groupings (phrases) Rules usually move whole phrases, not parts Words like “and” join phrases of the same type James and the elephant with a purple hat are eating

17 Phrase structure rules Chomsky’s “computer-like” formalism for building trees uses rules like these: S  NP VP (a sentence contains a noun phrase plus a verb phrase) NP  (Det) (Adj) N (a noun phrase contains optional determiner, e.g. the, plus optional adjective, plus a noun) VP  (Adv) V (NP) (a verb phrase contains an optional adverb, plus a verb, plus an optional noun phrase)

18 Different grammars, different rules Some English phrase structure rules S  NP VP VP  (Adv) V (NP) NP  (Det) (Adj) N (that S) Some Chinese phrase structure rules S  NP VP VP  (Adv) V (NP) NP  (Det) (Adj) (S 的 ) N

19 Phrase structure rules aren’t enough Find the last word in the following sentence: (1)What structure does this sentence have? Is the last word have? But normally have must be followed by an NP: (2)a. *This sentence has. b. This sentence has structure.

20 Deep structure? Even stranger, it’s ungrammatical to add an NP after have in sentence (1), as if something is “already there”: (3) *What structure does this sentence have structure? Chomsky concluded that sentences like (1) are built using rules that change some deep structure into the surface structure that we actually see and hear.

21 Deep structure and surface structure Sentence (1) would be derived like this: Deep: this sentence have what structure Surface: what structure does this sentence have Here it is, step by step: this sentence have what structuredoeswhat structure

22 Transformation rules In Chomsky’s theory, transformation rules change deep structure into surface structure Deep structures are NOT “sentences” this sentence have what structure Transformations need not happen in “real time” Generative grammar describes competence, not performance

23 Why should we believe this? Different deep structures may be related to different meanings (4)a. Why do you think that James is dumb? b. Why do you think that James is dumb ? There is even some performance evidence from experiments for these gaps.

24 Different grammars, different rules An English transformation rule wh-movement: Move wh-words to the beginning A Chinese transformation rule topicalization: Move topics to the beginning Deep: 你看過了今天的報紙嗎? Surface: 今天的報紙你看過了  嗎?

25 Constraints Grammars don’t have only rules, but also constraints: principles that mark forms as good or bad rather than changing them (5)a. She likes to eat [ cake and ice cream ]. b. *What does she like to eat [ cake and  ]? Constraint:An NP cannot contain a gap.

26 Summary of Chomsky’s views Human grammar (e.g. syntax) consists of atoms (words) rules and constraints The rules and constraints operate on classes They refer to structure The ability to learn words and rules is innate The constraints are innate and don’t have to be learned at all

27 Is Chomsky right? Many people question Chomsky’s views Are “words” and “rules” really so distinct? Must rules operate on whole classes, or can they be specific for specific words? Is structure really so important? How much of this really must be innate?