A Deterministic Co-reference System with Rich Syntactic Features and Semantic Knowledge Heeyoung Lee & Sudarshan Rangarajan Collaborators : Karthik Raghunathan.

Slides:



Advertisements
Similar presentations
Warm Up Example 1 Check whether the ordered pair is a solution of 2x – 3y > -2 a.(0,0) 2(0)-3(0)> -2 0> -2 True b.(0,1) 2(0)-3(1)> -2 -3> -2 False.
Advertisements

Understanding Tables on the Web Jingjing Wang. Problem to Solve A wealth of information in the World Wide Web Not easy to access or process by machine.
Distant Supervision for Relation Extraction without Labeled Data CSE 5539.
Specialized models and ranking for coreference resolution Pascal Denis ALPAGE Project Team INRIA Rocquencourt F Le Chesnay, France Jason Baldridge.
A Machine Learning Approach to Coreference Resolution of Noun Phrases By W.M.Soon, H.T.Ng, D.C.Y.Lim Presented by Iman Sen.
Progress update Lin Ziheng. System overview 2 Components – Connective classifier Features from Pitler and Nenkova (2009): – Connective: because – Self.
Simple Regression Equation Multiple Regression y = a + bx Test Score Slope y-intercept Predicted Score  y = a + b x + b x + b x ….. Predicted Score 
Multi-Task Transfer Learning for Weakly- Supervised Relation Extraction Jing Jiang Singapore Management University ACL-IJCNLP 2009.
Objectives AND logic OR logic Evaluating compound conditions with multiple logical operators Precedence when combining AND and OR operators Efficiency.
Event Extraction Using Distant Supervision Kevin Reschke, Martin Jankowiak, Mihai Surdeanu, Christopher D. Manning, Daniel Jurafsky 30 May 2014 Language.
Chapter 18: Discourse Tianjun Fu Ling538 Presentation Nov 30th, 2006.
A Joint Model For Semantic Role Labeling Aria Haghighi, Kristina Toutanova, Christopher D. Manning Computer Science Department Stanford University.
Easy-First Coreference Resolution Veselin Stoyanov and Jason Eisner Johns Hopkins University.
Introduction to Supervised Machine Learning Concepts PRESENTED BY B. Barla Cambazoglu February 21, 2014.
On the Importance of Text Analysis for Stock Price Prediction
Robust Textual Inference via Graph Matching Aria Haghighi Andrew Ng Christopher Manning.
Re-ranking for NP-Chunking: Maximum-Entropy Framework By: Mona Vajihollahi.
Coupling Semi-Supervised Learning of Categories and Relations by Andrew Carlson, Justin Betteridge, Estevam R. Hruschka Jr. and Tom M. Mitchell School.
Ang Sun Ralph Grishman Wei Xu Bonan Min November 15, 2011 TAC 2011 Workshop Gaithersburg, Maryland USA.
Chapter 6: Design of Expert Systems
Reranking Parse Trees with a SRL system Charles Sutton and Andrew McCallum University of Massachusetts June 30, 2005.
Stock Price Prediction with News Articles Qicheng Ma CS224n Final Project.
Detecting Anaphoricity and Antecedenthood for Coreference Resolution Olga Uryupina Institute of Linguistics, RAS.
Supervised models for coreference resolution Altaf Rahman and Vincent Ng Human Language Technology Research Institute University of Texas at Dallas 1.
Language-Independent Set Expansion of Named Entities using the Web Richard C. Wang & William W. Cohen Language Technologies Institute Carnegie Mellon University.
Markov Logic Networks: A Unified Approach To Language Processing Pedro Domingos Dept. of Computer Science & Eng. University of Washington Joint work with.
Improving Machine Learning Approaches to Coreference Resolution Vincent Ng and Claire Cardie Cornell Univ. ACL 2002 slides prepared by Ralph Grishman.
Anaphora Resolution Sanghoon Kwak Takahiro Aoyama.
A Global Relaxation Labeling Approach to Coreference Resolution Coling 2010 Emili Sapena, Llu´ıs Padr´o and Jordi Turmo TALP Research Center Universitat.
A Light-weight Approach to Coreference Resolution for Named Entities in Text Marin Dimitrov Ontotext Lab, Sirma AI Kalina Bontcheva, Hamish Cunningham,
Andreea Bodnari, 1 Peter Szolovits, 1 Ozlem Uzuner 2 1 MIT, CSAIL, Cambridge, MA, USA 2 Department of Information Studies, University at Albany SUNY, Albany,
Recognition of Multi-sentence n-ary Subcellular Localization Mentions in Biomedical Abstracts G. Melli, M. Ester, A. Sarkar Dec. 6, 2007
Empirical Methods in Information Extraction Claire Cardie Appeared in AI Magazine, 18:4, Summarized by Seong-Bae Park.
NATIONAL TECHNICAL UNIVERSITY OF ATHENS Image, Video And Multimedia Systems Laboratory Background
Event Extraction Using Distant Supervision Kevin Reschke, Mihai Surdeanu, Martin Jankowiak, David McClosky, Christopher Manning Nov 15, 2012.
Illinois-Coref: The UI System in the CoNLL-2012 Shared Task Kai-Wei Chang, Rajhans Samdani, Alla Rozovskaya, Mark Sammons, and Dan Roth Supported by ARL,
1 Query Operations Relevance Feedback & Query Expansion.
Prof. Howard A. Schmidt First president of the Information Security Forum (ISF)‏
Date: 2014/02/25 Author: Aliaksei Severyn, Massimo Nicosia, Aleessandro Moschitti Source: CIKM’13 Advisor: Jia-ling Koh Speaker: Chen-Yu Huang Building.
Markov Logic and Deep Networks Pedro Domingos Dept. of Computer Science & Eng. University of Washington.
A Cross-Lingual ILP Solution to Zero Anaphora Resolution Ryu Iida & Massimo Poesio (ACL-HLT 2011)
An Entity-Mention Model for Coreference Resolution with Inductive Logic Programming Xiaofeng Yang 1 Jian Su 1 Jun Lang 2 Chew Lim Tan 3 Ting Liu 2 Sheng.
Ang Sun Director of Research, Principal Scientist, inome
Template-Based Event Extraction Kevin Reschke – Aug 15 th 2013 Martin Jankowiak, Mihai Surdeanu, Dan Jurafsky, Christopher Manning.
Multilingual Opinion Holder Identification Using Author and Authority Viewpoints Yohei Seki, Noriko Kando,Masaki Aono Toyohashi University of Technology.
Author: Alex Groce, Daniel Kroening, and Flavio Lerda Computer Science Department, Carnegie Mellon University Pittsburgh, PA Source: R. Alur and.
Inference Protocols for Coreference Resolution Kai-Wei Chang, Rajhans Samdani, Alla Rozovskaya, Nick Rizzolo, Mark Sammons, and Dan Roth This research.
4. Relationship Extraction Part 4 of Information Extraction Sunita Sarawagi 9/7/2012CS 652, Peter Lindes1.
Support Vector Machines and Kernel Methods for Co-Reference Resolution 2007 Summer Workshop on Human Language Technology Center for Language and Speech.
Confidence Interval Estimation For statistical inference in decision making: Chapter 9.
FILTERED RANKING FOR BOOTSTRAPPING IN EVENT EXTRACTION Shasha Liao Ralph York University.
Wei Lu, Hwee Tou Ng, Wee Sun Lee National University of Singapore
Natural Language Processing for Underground Communications Dan Klein MURI Kickoff, 11/20/2009.
Department of Computer Science The University of Texas at Austin USA Joint Entity and Relation Extraction using Card-Pyramid Parsing Rohit J. Kate Raymond.
Correcting Misuse of Verb Forms John Lee, Stephanie Seneff Computer Science and Artificial Intelligence Laboratory, MIT, Cambridge ACL 2008.
Sales Certification The sales certification section is designed in order to provide you with all the tools and knowledge you will need to showcase the.
Scalable Person Re-identification on Supervised Smoothed Manifold
How to forecast solar flares?
A Brief Introduction to Distant Supervision
NYU Coreference CSCI-GA.2591 Ralph Grishman.
Recognizing Partial Textual Entailment
Clustering Algorithms for Noun Phrase Coreference Resolution
Relational Inference for Wikification
A Machine Learning Approach to Coreference Resolution of Noun Phrases
Introduction Task: extracting relational facts from text
A Machine Learning Approach to Coreference Resolution of Noun Phrases
Leveraging Textual Specifications for Grammar-based Fuzzing of Network Protocols Samuel Jero, Maria Leonor Pacheco, Dan Goldwasser, Cristina Nita-Rotaru.
Some preliminary results
Extracting Why Text Segment from Web Based on Grammar-gram
Presentation transcript:

A Deterministic Co-reference System with Rich Syntactic Features and Semantic Knowledge Heeyoung Lee & Sudarshan Rangarajan Collaborators : Karthik Raghunathan under the guidance of Mihai Surdeanu, Nate Chambers & Dan Jurafsky 1

The Problem boolean isCoreferent(Mention A, Mention B) isCoreferent(‘Sony’, ‘The Japanese Company’) : TRUE isCoreferent(‘Sony’, ‘it’) : TRUE isCoreferent(‘The Japanese Company’, ‘it’) : TRUE isCoreferent(‘it’, ‘camcorder market’) : FALSE isCoreferent(‘it’, ‘RCA’) : FALSE 2 ‘More important to the future of 8mm is Sony's success in the $2.3 billion camcorder market. The Japanese company already has 12% of the total camcorder market, ranking it third behind the RCA and Panasonic brands.’

Baseline System Simple Co-reference Resolution with Rich Syntactic and Semantic Features, by Aria Haghighi & Dan Klein (EMNLP 2009) Deterministic, single-pass, constraint-based system Included Syntactic salience & Agreement constraint checking. Lack of Semantic Knowledge in decision making. 3 ‘President Bush and his colleague had different opinions. However, the person who has the right to make the final decision is the president.’

Preliminary Error Analysis Corpora for Error Analysis : MUC-6 (Train Set); and for Experiments : MUC-6 & ACE 4

Simple Knowledge Extraction System (SKES) Seed & Mention Pairs Yield Semantic Patterns Yield Metrics used to refine pattern yield 5

Construct passes 6 Sort decision features – Highest precision first.

Multi-pass Coreference System Deterministic, multi-pass, constraint based system. Decisions based on more confident mention pairs first. Further decisions based on previously accumulated knowledge about mentions. 7 ‘President Bush and his colleague had different opinions. However, the person who has the right to make the final decision is the president.’

Result 8 Multi-pass system is more sensitive to error propagation -> need high precision passes. Higher precision, but lower recall and F1. Needs more passes to increase recall -> Future work ( & Co-reference decision Re-ranker)

Questions? Thank You! 9