Automatic Metaphor Interpretation as a Paraphrasing Task Ekaterina Shutova Computer Lab, University of Cambridge NAACL 2010.

Slides:



Advertisements
Similar presentations
Reasons for (prior) belief in Bayesian epistemology
Advertisements

By Anthony Campanaro & Dennis Hernandez
ENGLISH B HIGHER LEVEL The Mackay School – May 2014 Examinations.
CS460/IT632 Natural Language Processing/Language Technology for the Web Lecture 2 (06/01/06) Prof. Pushpak Bhattacharyya IIT Bombay Part of Speech (PoS)
A UTOMATICALLY A CQUIRING A S EMANTIC N ETWORK OF R ELATED C ONCEPTS Date: 2011/11/14 Source: Sean Szumlanski et. al (CIKM’10) Advisor: Jia-ling, Koh Speaker:
Using prosody to avoid ambiguity: Effects of speaker awareness and referential context Snedeker and Trueswell (2003) Psych 526 Eun-Kyung Lee.
TEMPLATE DESIGN © Identifying Noun Product Features that Imply Opinions Lei Zhang Bing Liu Department of Computer Science,
Playing the Telephone Game: Determining the Hierarchical Structure of Perspective and Speech Expressions Eric Breck and Claire Cardie Department of Computer.
LEDIR : An Unsupervised Algorithm for Learning Directionality of Inference Rules Advisor: Hsin-His Chen Reporter: Chi-Hsin Yu Date: From EMNLP.
Active ReadingStrategies. Reader Reception Theory emphasizes that the reader actively interprets the text based on his or her particular cultural background.
Predicting Text Quality for Scientific Articles Annie Louis University of Pennsylvania Advisor: Ani Nenkova.
Predicting Text Quality for Scientific Articles AAAI/SIGART-11 Doctoral Consortium Annie Louis : Louis A. and Nenkova A Automatically.
Faculty Of Applied Science Simon Fraser University Cmpt 825 presentation Corpus Based PP Attachment Ambiguity Resolution with a Semantic Dictionary Jiri.
EPSY 430 Behavioral Constructs Behavioral Constructs Three Behavioral Domains.
Essay Exams Indiana State U & Purdue Writing Guides!
Gimme’ The Context: Context- driven Automatic Semantic Annotation with CPANKOW Philipp Cimiano et al.
Semantic distance in WordNet: An experimental, application-oriented evaluation of five measures Presenter: Cosmin Adrian Bejan Alexander Budanitsky and.
Inducing Information Extraction Systems for New Languages via Cross-Language Projection Ellen Riloff University of Utah Charles Schafer, David Yarowksy.
1 Noun Homograph Disambiguation Using Local Context in Large Text Corpora Marti A. Hearst Presented by: Heng Ji Mar. 29, 2004.
1 LM Approaches to Filtering Richard Schwartz, BBN LM/IR ARDA 2002 September 11-12, 2002 UMASS.
Learning Subjective Adjectives from Corpora Janyce M. Wiebe Presenter: Gabriel Nicolae.
Some definitions Morphemes = smallest unit of meaning in a language Phrase = set of one or more words that go together (from grammar) (e.g., subject clause,
Scientific method - 1 Scientific method is a body of techniques for investigating phenomena and acquiring new knowledge, as well as for correcting and.
A Framework for Named Entity Recognition in the Open Domain Richard Evans Research Group in Computational Linguistics University of Wolverhampton UK
From Semantic Similarity to Semantic Relations Georgeta Bordea, November 25 Based on a talk by Alessandro Lenci titled “Will DS ever become Semantic?”,
Conceptual modelling. Overview - what is the aim of the article? ”We build conceptual models in our heads to solve problems in our everyday life”… ”By.
Mining and Summarizing Customer Reviews
A Light-weight Approach to Coreference Resolution for Named Entities in Text Marin Dimitrov Ontotext Lab, Sirma AI Kalina Bontcheva, Hamish Cunningham,
Evaluating the Contribution of EuroWordNet and Word Sense Disambiguation to Cross-Language Information Retrieval Paul Clough 1 and Mark Stevenson 2 Department.
Empirical Methods in Information Extraction Claire Cardie Appeared in AI Magazine, 18:4, Summarized by Seong-Bae Park.
1 Statistical NLP: Lecture 10 Lexical Acquisition.
1 Bayesian Learning for Latent Semantic Analysis Jen-Tzung Chien, Meng-Sun Wu and Chia-Sheng Wu Presenter: Hsuan-Sheng Chiu.
1 Wikification CSE 6339 (Section 002) Abhijit Tendulkar.
Author: James Allen, Nathanael Chambers, etc. By: Rex, Linger, Xiaoyi Nov. 23, 2009.
A Survey for Interspeech Xavier Anguera Information Retrieval-based Dynamic TimeWarping.
Ontology-Driven Automatic Entity Disambiguation in Unstructured Text Jed Hassell.
Annotating Words using WordNet Semantic Glosses Julian Szymański Department of Computer Systems Architecture, Faculty of Electronics, Telecommunications.
1 Statistical NLP: Lecture 9 Word Sense Disambiguation.
Improving Subcategorization Acquisition using Word Sense Disambiguation Anna Korhonen and Judith Preiss University of Cambridge, Computer Laboratory 15.
SYMPOSIUM ON SEMANTICS IN SYSTEMS FOR TEXT PROCESSING September 22-24, Venice, Italy Combining Knowledge-based Methods and Supervised Learning for.
Recognizing Names in Biomedical Texts: a Machine Learning Approach GuoDong Zhou 1,*, Jie Zhang 1,2, Jian Su 1, Dan Shen 1,2 and ChewLim Tan 2 1 Institute.
LOGIC AND ONTOLOGY Both logic and ontology are important areas of philosophy covering large, diverse, and active research projects. These two areas overlap.
CS 4705 Lecture 19 Word Sense Disambiguation. Overview Selectional restriction based approaches Robust techniques –Machine Learning Supervised Unsupervised.
Automatic Image Annotation by Using Concept-Sensitive Salient Objects for Image Content Representation Jianping Fan, Yuli Gao, Hangzai Luo, Guangyou Xu.
1 Learning Sub-structures of Document Semantic Graphs for Document Summarization 1 Jure Leskovec, 1 Marko Grobelnik, 2 Natasa Milic-Frayling 1 Jozef Stefan.
Modelling Human Thematic Fit Judgments IGK Colloquium 3/2/2005 Ulrike Padó.
Unsupervised Learning of Visual Sense Models for Polysemous Words Kate Saenko Trevor Darrell Deepak.
Automatic Identification of Pro and Con Reasons in Online Reviews Soo-Min Kim and Eduard Hovy USC Information Sciences Institute Proceedings of the COLING/ACL.
Using Semantic Relations to Improve Passage Retrieval for Question Answering Tom Morton.
1/21 Automatic Discovery of Intentions in Text and its Application to Question Answering (ACL 2005 Student Research Workshop )
Teaching Reading By Nikmah Nurbaity
Named Entity Disambiguation on an Ontology Enriched by Wikipedia Hien Thanh Nguyen 1, Tru Hoang Cao 2 1 Ton Duc Thang University, Vietnam 2 Ho Chi Minh.
Creating Subjective and Objective Sentence Classifier from Unannotated Texts Janyce Wiebe and Ellen Riloff Department of Computer Science University of.
Number Sense Disambiguation Stuart Moore Supervised by: Anna Korhonen (Computer Lab)‏ Sabine Buchholz (Toshiba CRL)‏
Finding document topics for improving topic segmentation Source: ACL2007 Authors: Olivier Ferret (18 route du Panorama, BP6) Reporter:Yong-Xiang Chen.
Using Wikipedia for Hierarchical Finer Categorization of Named Entities Aasish Pappu Language Technologies Institute Carnegie Mellon University PACLIC.
From Words to Senses: A Case Study of Subjectivity Recognition Author: Fangzhong Su & Katja Markert (University of Leeds, UK) Source: COLING 2008 Reporter:
Using Semantic Relations to Improve Information Retrieval
Overview of Statistical NLP IR Group Meeting March 7, 2006.
Word Sense and Subjectivity (Coling/ACL 2006) Janyce Wiebe Rada Mihalcea University of Pittsburgh University of North Texas Acknowledgements: This slide.
Correcting Misuse of Verb Forms John Lee, Stephanie Seneff Computer Science and Artificial Intelligence Laboratory, MIT, Cambridge ACL 2008.
An Ontology-based Automatic Semantic Annotation Approach for Patent Document Retrieval in Product Innovation Design Feng Wang, Lanfen Lin, Zhou Yang College.
An Adaptive Learning with an Application to Chinese Homophone Disambiguation from Yue-shi Lee International Journal of Computer Processing of Oriental.
Writing Technical Reports
Coarse-grained Word Sense Disambiguation
Sentiment analysis algorithms and applications: A survey
Statistical NLP: Lecture 9
Approached to Discourse Analysis
Statistical NLP : Lecture 9 Word Sense Disambiguation
Statistical NLP: Lecture 10
Presentation transcript:

Automatic Metaphor Interpretation as a Paraphrasing Task Ekaterina Shutova Computer Lab, University of Cambridge NAACL 2010

Outline What is metaphor The idea and overview of the system Experimental data Method Evaluation Conclusion

Metaphor in this paper Metaphor arise when one concept is viewed in terms of the properties of the other. – News travels fast. – How can I kill the process? – And then my heart with pleasure fills, And dances with the daffodils.

Automatic processing of metaphor Metaphor recognition – Distinguishing between literal and metaphorical language in text. Metaphor interpretation – Indentifying the intended literal meaning of a metaphorical expression.

Interpretation as paraphrasing Phrases – All of this stirred and uncontrollable excitement in her. – A carelessly leaked report. Their paraphrases – All of this provoked an uncontrollable excitement in her. – A carelessly disclosed report.

System overview Produces a list of all possible paraphrases for a metaphorical expression. Ranks the paraphrases according to their likelihood derived from the corpus. Discriminates between literal and figurative paraphrases by detecting selectional preference violation and output the literal ones. Disambiguates the sense of the paraphrases using WordNet inventory of senses.

Experimental data Focused on single-word metaphors expressed by a verb. – Classification according to whether the verbs are used metaphorically or literally. – Some verbs have weak or no potential of being a metaphor are excluded. Auxiliary verbs Model verbs Aspectual verbs Light verbs

Dataset The corpus is a subset of the British National Corpus (BNC) that contains 761 sentences and words. Annotated based on the principles of the metaphor identification procedure (MIP). – A form of word sense disambiguation with an emphasis on metaphoricity.

Annotation Discriminate between verbs used metaphorically and literally. – For each verb establish its meaning in context and try to imagine a more basic meaning of this verb on other contexts. More concrete Related to bodily action More precise (as opposed to vague) Historically older – If you can establish the basic meaning that is distinct from the meaning of the verb in this context, the verb is likely to be used metaphorically.

Example If he asked her to post a letter or buy some razor blades from the chemist, she was transported while pleasure. – The verb transport in its basic sense is used in the context of “goods being transported/carried by a vehicle”.

Phrase selection Only the phrases that were tagged as metaphorical by all the annotators were included in the test set. – memories were slipping away. – hold the truth back. – factors shape results Some phrases are excluded from the test set – Subject or object referent is unknown. – Metaphorical meaning is realized solely in passive constructions. – Subject or object of interest are represented by a named entity. – Multiword metaphors. The resulting test set contains 62 metaphorical expression.

Paraphrase ranking The likelihood of a particular paraphrase as a joint probability – Carelessly [w1] leaked [i] report [w2]

Paraphrase ranking Rank the possible replacements of the term used metaphorically in the fixed context according to the data by the likelihood.

Filter the paraphrases Filter out the terms whose meaning does not share any common features with that of the metaphorical term. – Kill a process Terminate a process Kill implies an end or termination of life Identifying shared meanings using hyponymy relations in the WordNet taxonomy.

Filtering based on selectional preferences Remove the irrelevant paraphrases and paraphrases where the substitute is used metaphorically again. – Suppress the truth. The verbs used metaphorically are likely to demonstrate strong semantic preference for the source domain than for the target domain. – Suppress would select for movements (political) rather than ideas or truth (target domain).

Association measure Resnik (1997) models selectional preference of a verb in probabilistic terms as the difference between the posterior distribution of noun classes in a particular relation with the verb and their prior distribution using the relative entropy (Kullback-Leibler distance):

Evaluation 7 annotators were asked to mark the ones that have the same meaning as the term used metaphorically and are used literally in the context of the paraphrase expression as correct. Agreement is 0.62 (k) Accuracy measure the proportion of correct literal interpretations among the paraphrase in rank 1.

Conclusion A system that produces literal paraphrases for metaphorical expressions. Directly transferable to other applications that can benefic from a metaphor processing component. Does not rely on any hand-crafted knowledge other than WordNet.