LING/C SC/PSYC 438/538 Lecture 25 Sandiway Fong.

Slides:



Advertisements
Similar presentations
LING 388: Language and Computers
Advertisements

Computational language: week 10 Lexical Knowledge Representation concluded Syntax-based computational language Sentence structure: syntax Context free.
Bottom up Parsing Bottom up parsing trys to transform the input string into the start symbol. Moves through a sequence of sentential forms (sequence of.
LING 388: Language and Computers Sandiway Fong Lecture 2.
LING 438/538 Computational Linguistics Sandiway Fong Lecture 7: 9/12.
LING 438/538 Computational Linguistics Sandiway Fong Lecture 9: 9/21.
LING/C SC/PSYC 438/538 Computational Linguistics Sandiway Fong Lecture 8: 9/18.
LING/C SC/PSYC 438/538 Computational Linguistics Sandiway Fong Lecture 7: 9/11.
LING 438/538 Computational Linguistics Sandiway Fong Lecture 22: 11/15.
LING/C SC/PSYC 438/538 Computational Linguistics Sandiway Fong Lecture 6: 9/6.
LING 388 Language and Computers Take-Home Final Examination 12/9/03 Sandiway FONG.
Parsing SLP Chapter 13. 7/2/2015 Speech and Language Processing - Jurafsky and Martin 2 Outline  Parsing with CFGs  Bottom-up, top-down  CKY parsing.
SI485i : NLP Set 9 Advanced PCFGs Some slides from Chris Manning.
11 CS 388: Natural Language Processing: Syntactic Parsing Raymond J. Mooney University of Texas at Austin.
LING/C SC/PSYC 438/538 Lecture 19 Sandiway Fong 1.
LING 388: Language and Computers Sandiway Fong Lecture 11.
Context Free Grammars Reading: Chap 12-13, Jurafsky & Martin This slide set was adapted from J. Martin, U. Colorado Instructor: Paul Tarau, based on Rada.
LING 388: Language and Computers Sandiway Fong Lecture 17.
11/22/1999 JHU CS /Jan Hajic 1 Introduction to Natural Language Processing ( ) Shift-Reduce Parsing in Detail Dr. Jan Hajič CS Dept., Johns.
CS : Speech, Natural Language Processing and the Web/Topics in Artificial Intelligence Pushpak Bhattacharyya CSE Dept., IIT Bombay Lecture 12: Deeper.
LING 388: Language and Computers Sandiway Fong Lecture 3.
LING 388: Language and Computers Sandiway Fong Lecture 18.
LING 388: Language and Computers Sandiway Fong Lecture 10.
Context Free Grammars Reading: Chap 9, Jurafsky & Martin This slide set was adapted from J. Martin, U. Colorado Instructor: Rada Mihalcea.
LING 388: Language and Computers Sandiway Fong Lecture 13.
October 2008CSA3180: Sentence Parsing1 CSA3180: NLP Algorithms Sentence Parsing Algorithms 2 Problems with DFTD Parser.
LING/C SC/PSYC 438/538 Lecture 26 Sandiway Fong. Administrivia 538 Presentations – Send me your choices if you haven’t already Thanksgiving Holiday –
1 Syntax 2 Essays: deadline extended to Monday 2nd, but must be printed on paper. ed essays must still arrive by 30th. Morphology homework by 26th.
LING 388: Language and Computers Sandiway Fong Lecture 12.
Rules, Movement, Ambiguity
PARSING 2 David Kauchak CS159 – Spring 2011 some slides adapted from Ray Mooney.
LING/C SC/PSYC 438/538 Lecture 13 Sandiway Fong. Administrivia Reading Homework – Chapter 3 of JM: Words and Transducers.
CS 4705 Lecture 10 The Earley Algorithm. Review Top-Down vs. Bottom-Up Parsers –Both generate too many useless trees –Combine the two to avoid over-generation:
Top-down Parsing Recursive Descent & LL(1) Comp 412 Copyright 2010, Keith D. Cooper & Linda Torczon, all rights reserved. Students enrolled in Comp 412.
LING/C SC/PSYC 438/538 Lecture 20 Sandiway Fong 1.
LING/C SC/PSYC 438/538 Lecture 18 Sandiway Fong. Adminstrivia Homework 7 out today – due Saturday by midnight.
LING/C SC/PSYC 438/538 Lecture 16 Sandiway Fong. SWI Prolog Grammar rules are translated when the program is loaded into Prolog rules. Solves the mystery.
CS460/IT632 Natural Language Processing/Language Technology for the Web Lecture 13 (17/02/06) Prof. Pushpak Bhattacharyya IIT Bombay Top-Down Bottom-Up.
November 2009HLT: Sentence Parsing1 HLT Sentence Parsing Algorithms 2 Problems with Depth First Top Down Parsing.
LING/C SC/PSYC 438/538 Lecture 19 Sandiway Fong 1.
PARSING David Kauchak CS159 – Fall Admin Assignment 3 Quiz #1  High: 36  Average: 33 (92%)  Median: 33.5 (93%)
LING/C SC 581: Advanced Computational Linguistics Lecture Notes Feb 17 th.
King Faisal University جامعة الملك فيصل Deanship of E-Learning and Distance Education عمادة التعلم الإلكتروني والتعليم عن بعد [ ] 1 King Faisal University.
Natural Language Processing Vasile Rus
Basic Parsing with Context Free Grammars Chapter 13
Friday, March 9 Introduction Class
LING/C SC/PSYC 438/538 Lecture 10 Sandiway Fong.
LING/C SC/PSYC 438/538 Lecture 23 Sandiway Fong.
LING/C SC/PSYC 438/538 Lecture 5 Sandiway Fong.
CS : Speech, NLP and the Web/Topics in AI
LING/C SC/PSYC 438/538 Lecture 21 Sandiway Fong.
LING/C SC/PSYC 438/538 Lecture 20 Sandiway Fong.
CSCI 5832 Natural Language Processing
LING/C SC/PSYC 438/538 Lecture 4 Sandiway Fong.
LING/C SC 581: Advanced Computational Linguistics
LING/C SC/PSYC 438/538 Lecture 3 Sandiway Fong.
Natural Language - General
Parsing and More Parsing
LING/C SC/PSYC 438/538 Lecture 23 Sandiway Fong.
LING/C SC/PSYC 438/538 Lecture 21 Sandiway Fong.
LING/C SC/PSYC 438/538 Lecture 22 Sandiway Fong.
LING/C SC/PSYC 438/538 Lecture 24 Sandiway Fong.
LING/C SC/PSYC 438/538 Lecture 26 Sandiway Fong.
CSA2050 Introduction to Computational Linguistics
David Kauchak CS159 – Spring 2019
Welcome to sixth grade! 07/31/2017
David Kauchak CS159 – Spring 2019
LING/C SC/PSYC 438/538 Lecture 3 Sandiway Fong.
LING/C SC 581: Advanced Computational Linguistics
Parsing CSCI 432 Computer Science Theory
Presentation transcript:

LING/C SC/PSYC 438/538 Lecture 25 Sandiway Fong

Today's Topics Homework 12 review 538 Presentations Grammar transformation: solving left recursive phrase structure

Homework 12 Review From Homework 11: John ate (sensibly) (intransitive eat) I fish (intransitive fish) I ate fish (transitive eat) Bill ate rice Harry ate roast beef

Last Time g.pl

Homework 12 Review From Ross (1970), English exhibits (forward) gapping: I ate fish, Bill rice, and Harry roast beef cf. I ate fish, Bill ate rice, and Harry ate roast beef Forwards only (cf. Japanese: backwards): I ate fish, Bill ate rice, and Harry roast beef *I fish, Bill rice, and Harry ate roast beef *I fish, Bill ate rice, and Harry ate roast beef (<-NOT gapping) *I fish, Bill ate rice, and Harry roast beef (<-NOT gapping) Parallelism requirement: *I ate fish, Bill, and Harry roast beef *I ate fish, Bill rice, and Harry

Homework 12 Review

Homework 12 Review

Homework 12 Review Stanford Parser I ate fish, Bill rice, and Harry roast beef (=2a) (Ross 1970) Stanford Parser

Homework 12 Review Berkeley Parser:

Homework 12 Review Google AI Blog Wired magazine

Homework 12 Review I ate fish, Bill rice, and Harry roast beef (=2a) (Ross 1970) Google (DRAGNN, successor to SyntaxNet)

Homework 12 Review I fish, Bill rice, and Harry (fish) beef roast eat UDPipe:

538 Presentations From the syllabus homeworks: 100% homeworks: 75% 438 homeworks: 100% 538 homeworks: 75% sub-chapter presentation: 25% If you are currently taking 438, and you plan to do the HLT Master's Program consider volunteering to do the presentation for a waiver later.

538 Presentations next semester this course continues as 581 We can’t cover as many topics as we’d like this semester next semester this course continues as 581 Select a topic from some sections from the textbook not a full chapter don’t pick something too big or too small … Range: chapter 14 through 25 you can’t pick the same thing as your classmate First come, first served basis

538 Presentations Your job: present the selected topic in class produce slides (send to me first) you’ll be evaluated on the quality of the presentation don’t just simply copy the textbook! important: you'll be evaluated on how well you communicate the essential ideas employed communicate your understanding of the tradeoffs and limitations etc. be prepared to take questions from me and your fellow classmates

538 Presentations Tuesday: November 27th Thursday: November 29th Scheduling Topic selection: begins now Talk length: 8 mins first come, first served basis Email me your 1st, 2nd and 3rd choices Email me your 1st, 2nd and 3rd choice of presentation dates: Tuesday: November 27th Thursday: November 29th Tuesday: December 4th

Left recursion and Prolog Left recursive grammars: we know from an earlier lecture that left recursive rules are a no-no given Prolog’s left-to-right depth- first computation rule… s a ... Example: s --> a, [!]. a --> ba, [a]. a --> a, [a]. ba --> b, [a]. b --> [b]. ?- s([b,a,!],[]). ERROR: Out of local stack rule for nonterminal a immediately calls a

Preposition Phrase (PP) Attachment The preferred syntactic analysis is a left recursive parse Examples: John saw the boy with a telescope (structural ambiguity: automatically handled by Prolog) withinstrument withpossessive

Preposition Phrase (PP) Attachment The preferred syntactic analysis is a left recursive parse Can “stack” the PPs: John saw the boy with a limp with Mary with a telescope ambiguity: withpossessive , withaccompaniment, withinstrument

Preposition Phrase Attachment Linguistically: PP (recursively) adjoins to NP or VP np(np(NP,PP)) --> np(NP), pp(PP). vp(vp(VP,PP)) --> vp(VP), pp(PP). Left recursion gives Prolog problems Derivation (top-down, left-to-right) sentential forms: vp vp pp vp pp pp vp pp pp pp vp pp pp pp pp infinite loop… Note: other extra arguments not shown here …

Transformation Apply the general transformation: to NP and VP rules: np(np(DT,NN)) --> dt(DT,Number), nn(NN,Number). np(np(NP,PP)) --> np(NP), pp(PP). vp(vp(VBD,NP)) --> vbd(VBD), np(NP). vp(vp(VP,PP)) --> vp(VP), pp(PP). x(X) --> [z], w(X,x(z)). x(x(z)) --> [z]. w(W,X) --> [y], w(W,x(X,y)). w(x(X,y),X) --> [y]. Note: w is a fresh non-terminal that takes 2 arguments x(x(X,y)) --> x(X), [y]. x(x(z)) --> [z]. [z] [y] x x x is the recursive nonterminal [z] [y] x x Let's write some code!